-- Logs begin at Mon 2022-05-16 16:11:59 UTC, end at Mon 2022-05-16 17:44:54 UTC. -- May 16 16:41:46.594777 dv-cinder-839987-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 16 16:41:46.601938 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 16 16:41:46 2022] *** May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: nodename: dv-cinder-839987-4-iscsi May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: machine: x86_64 May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: clock source: unix May 16 16:41:46.604003 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: pcre jit disabled May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: detected number of CPU cores: 4 May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: current working directory: / May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: detected binary path: /usr/bin/uwsgi-core May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: your processes number limit is 47680 May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: your memory page size is 4096 bytes May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: detected max file descriptor number: 2048 May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: lock engine: pthread robust mutexes May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: thunder lock: enabled May 16 16:41:46.604397 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 16 16:41:46.604823 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 16 16:41:46.650750 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: Python main interpreter initialized at 0x55599533d9c0 May 16 16:41:46.650750 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: python threads support enabled May 16 16:41:46.650750 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: your server socket listen backlog is limited to 100 connections May 16 16:41:46.650750 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: your mercy for graceful operations on workers is 90 seconds May 16 16:41:46.651107 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: mapped 403077 bytes (393 KB) for 2 cores May 16 16:41:46.651165 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: *** Operational MODE: preforking *** May 16 16:41:46.651454 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: *** uWSGI is running in multiple interpreter mode *** May 16 16:41:46.651454 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: spawned uWSGI master process (pid: 79942) May 16 16:41:46.651664 dv-cinder-839987-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 16 16:41:46.653590 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: spawned uWSGI worker 1 (pid: 79955, cores: 1) May 16 16:41:46.653590 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: spawned uWSGI worker 2 (pid: 79956, cores: 1) May 16 16:41:46.653590 dv-cinder-839987-4-iscsi devstack@keystone.service[79942]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 16 16:41:52.373863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:41:52.373863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: from cryptography.utils import int_from_bytes May 16 16:41:52.375190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:41:52.375190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: from cryptography.utils import int_from_bytes May 16 16:41:52.376800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:41:52.376800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: from cryptography.utils import int_from_bytes May 16 16:41:52.378161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 16 16:41:52.378161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: from cryptography.utils import int_from_bytes May 16 16:41:52.424395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 16:41:52.424584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 16:41:52.424786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] command line args: [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 16:41:52.425056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 16:41:52.425236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ================================================================================ {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 16:41:52.425489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] admin_token = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.425757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] config_dir = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.425951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.426134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] config_source = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.426315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] debug = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.426513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_config_append = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_dir = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.428761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_file = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.429232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.429298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 16 16:41:52.429298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 16 16:41:52.429413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.429471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] command line args: [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 16 16:41:52.429527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.429594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 16 16:41:52.429656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.429721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ================================================================================ {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 16 16:41:52.430151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.430151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.430784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] admin_token = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.430859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.430924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] config_dir = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.430924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] config_source = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] debug = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.431946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.432159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.432356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.432547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.432547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.432928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.433121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_config_append = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.433121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.433121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_dir = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.433667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.433962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_file = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.434179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] publish_errors = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.434374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.434566 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.434799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.434970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.434970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.435336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.435563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.435735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.435735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.436123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.436314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.436505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] standard_threads = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.436673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.436813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.436987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] use_journal = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] use_json = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.437986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] use_stderr = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] use_syslog = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.438967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.439101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.439238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.439238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.439238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.439656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.439656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] publish_errors = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.439905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.440032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.440157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.440289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.440425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.440553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.440690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.440825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.440954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.441080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.441214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.441341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] standard_threads = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.441474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.441607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.441772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.441918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.441918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.442177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.442305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] use_journal = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.442437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.442574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] use_json = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.442574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] use_stderr = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.442898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.443036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] use_syslog = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.443163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.443296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 16 16:41:52.443424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.443549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.443687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.443815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.443943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.444878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.445843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.446011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.446696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.446849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.446984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.447940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.448903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.449847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.450971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.451097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.451360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.451510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.451652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.451781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.451920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.452975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453616 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.453900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.454042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.454178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.455362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.455536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.455729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.455919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.456154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.456321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.456510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.456700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.456889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.457084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.457315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.457478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.457793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.458015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.458180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.458371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.458596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.458764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.458764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.459136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.459324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.459520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.459746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.459959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.460125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.460324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.460496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.460628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.460801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.460940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.461106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.461249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.461395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.461570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.461707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.461888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.462945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.463880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.464904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.465972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.466883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.467874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.468906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.469995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.external = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.470920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.password = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.471997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] auth.token = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.472917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.473947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.474875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.external = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.475889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.password = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] auth.token = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.476808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.477070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.477850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.477995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.478126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.478381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.478534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.478668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.478797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.478927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.479991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.480911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.481905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.482923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.483992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.484918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.485899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.486940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.487873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.488003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.488140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.488271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.488400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.488529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.488658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.489876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.490938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491735 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.491863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.492788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.493467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.493600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.493752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.493890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.494937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.495998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.496921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.497891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.498949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.499868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.500931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.501174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.501303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.501432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.501574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.501708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.501860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.502949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.503863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.504932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.505887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.506944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.507854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.508984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.509928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] role.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] role.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.510974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.511225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.511357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.511485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.511623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.511753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.511888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.512940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] role.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.513905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] role.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.514926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.515990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.516903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.517963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.518889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.519943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.520996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.521963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.522898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.523939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.connection = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.524883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.525959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.526875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.connection = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.527941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.528871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79955) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.529392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.530589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.530589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.530589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.530589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 16 16:41:52.530589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79956) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 16 16:41:52.541976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.542210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.542437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.543780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.544011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.544239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.551185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.552935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.580042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.580260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.581325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.581557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.634406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.634657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.686080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.686356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.686501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.686640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.752263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.752519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.752671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.752844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.752984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.753970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.776473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.776675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.776826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.776997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.777983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.778115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.778370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.778536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.789053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.789217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.804017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.804247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.804512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.804696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.804832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.804965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.805106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.805253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.805959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.806102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.806235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79956) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.806366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.806366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.806366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79955) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 16 16:41:52.823079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.823287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 16:41:52.823624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.823821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 16:41:52.824291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.824435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.824566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.824724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.824864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.825005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 16:41:52.825241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.825434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 16 16:41:52.825694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.825969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.826217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.826464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.835791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.836072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.836336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.837137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.837980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.838250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.838508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.838779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.845188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.846835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.848476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.848752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.849026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.849412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.849693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.849973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.850111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.850244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.850375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.850507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.850649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.850794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.850983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.851120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.851253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.851392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.851526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.851803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.852016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.852333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.853101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.853374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.886051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.886302 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.886461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.886461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.886745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.886745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.887010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.887010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.887010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.889679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.889979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.890254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.893658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.893961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.897538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.897835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.898572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.898856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.899657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.899935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.900205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.900472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.900739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.901002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.902940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.903222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.903497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.903773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.904041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.904307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.904572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.904834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.920062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.920337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.924115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.924390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.924826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.928455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.928749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.928905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.932487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.932773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.933697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.937269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.937662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.940974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.941202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.941349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.941539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.941846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.942132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.942397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.944897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.945189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.945466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.945757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.946094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.946367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.964679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.965123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.965457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.965776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.965869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.966149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.966412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.966670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.973927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.974497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.975822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.976157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.976243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.976451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.979966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.980060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.980284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.980368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.980562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.980661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.980842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.981072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.981157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.981419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.994654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.994926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.995197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.995280 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:52.995479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.995577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.995752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.995976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.996061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.996275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.996367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.996630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.996912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:52.997180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.014064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.015069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.017572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.018355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.020874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.021660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.022485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.023267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.024848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.025123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.025378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.025520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.025665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.025956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.032729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.033326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.034326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.035092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.037503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.037823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.038100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.038367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.038508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.038734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.039016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.039289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.048082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.048400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.048650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.049055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.049358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.049637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.056649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79955) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.056925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.057198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.057468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.057649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79956) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 16 16:41:53.057816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.057956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.058939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.059983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.060128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.060263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.060436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79955) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.060572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.060572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.060825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.061013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79956) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 16 16:41:53.098824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55599533d9c0 pid: 79955 (default app) May 16 16:41:53.099898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55599533d9c0 pid: 79956 (default app) May 16 16:41:53.102281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e357-d4d7-48c5-b54a-7227cd356482 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:41:53.103077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e357-d4d7-48c5-b54a-7227cd356482 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:41:53.103359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1e357-d4d7-48c5-b54a-7227cd356482 None None] PATH_INFO: `/v3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:41:53.107523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Mon May 16 16:41:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:01.058682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c579-6aaa-4236-b57a-8fedda4cdc3f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:01.059252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c579-6aaa-4236-b57a-8fedda4cdc3f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:01.059252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c579-6aaa-4236-b57a-8fedda4cdc3f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:01.063564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:01.068714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:01.069131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:01.069262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:01.099870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG oslo_db.sqlalchemy.engines [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79955) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:42:01.282284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG passlib.handlers.bcrypt [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79955) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 16:42:01.282800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG passlib.handlers.bcrypt [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79955) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 16:42:01.338912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:01.340538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:01.464205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 16 16:42:01.610628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c579-6aaa-4236-b57a-8fedda4cdc3f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:01.644774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG oslo_db.sqlalchemy.engines [None req-3117c579-6aaa-4236-b57a-8fedda4cdc3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79956) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 16 16:42:01.770757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c579-6aaa-4236-b57a-8fedda4cdc3f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:01.774932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:01.775577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:01.775848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:01.776114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:01.784003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:01.837390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING keystone.common.rbac_enforcer.enforcer [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 16:42:01.837723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a1545-6510-4fc9-9c48-7c816dca76ad admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:01.847000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Mon May 16 16:42:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 16:42:01.853402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:01.867722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a1f3f-f972-48b3-899f-ef3d47da1273 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:01.872012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:01.873117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:01.873398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:01.873675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] PATH_INFO: `/v3/projects/eca989f1268f4da189675a074fd55f83` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:01.875225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] RBAC: Authorizing `identity:get_project(project_id=eca989f1268f4da189675a074fd55f83)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:01.926205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 16 16:42:01.926539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515b485-c9a7-4b5e-8c9d-9c58bebd1dff admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:01.931050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Mon May 16 16:42:01 2022] GET /identity/v3/projects/eca989f1268f4da189675a074fd55f83 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:04.123505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9bc3-a6b2-4154-8b7c-e0d811ad11f1 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:04.124197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9bc3-a6b2-4154-8b7c-e0d811ad11f1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:04.124197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9bc3-a6b2-4154-8b7c-e0d811ad11f1 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:04.128101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:04.133475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:04.133942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:04.134044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:04.155455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:04.156959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:04.165297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 16 16:42:04.187174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9bc3-a6b2-4154-8b7c-e0d811ad11f1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:04.198936 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9bc3-a6b2-4154-8b7c-e0d811ad11f1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:04.203173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69b4cc-b16a-4f95-9106-b7082ebdcd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:04.203807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69b4cc-b16a-4f95-9106-b7082ebdcd58 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:04.204087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69b4cc-b16a-4f95-9106-b7082ebdcd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:04.204359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69b4cc-b16a-4f95-9106-b7082ebdcd58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:04.212377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69b4cc-b16a-4f95-9106-b7082ebdcd58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:04.214224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69b4cc-b16a-4f95-9106-b7082ebdcd58 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:04.222749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Mon May 16 16:42:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 16:42:04.228663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:04.237530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c19fa-e364-4749-bd39-e66c4bf9aeca None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:04.242151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e957ff-3e26-43e7-bd8d-b9e4bb743c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:04.243033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e957ff-3e26-43e7-bd8d-b9e4bb743c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:04.243311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e957ff-3e26-43e7-bd8d-b9e4bb743c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:04.243585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e957ff-3e26-43e7-bd8d-b9e4bb743c9e admin admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:04.244973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e957ff-3e26-43e7-bd8d-b9e4bb743c9e admin admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:04.246843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e957ff-3e26-43e7-bd8d-b9e4bb743c9e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:04.248410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Mon May 16 16:42:04 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:06.539927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e67d0-7d85-4b1f-862c-635a8d054a5e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:06.540454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e67d0-7d85-4b1f-862c-635a8d054a5e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:06.540454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e67d0-7d85-4b1f-862c-635a8d054a5e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:06.541995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:06.547159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:06.547589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:06.547695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:06.569221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e7e5-0ea9-4c64-9351-bc4f31f62d75 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:06.569503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e7e5-0ea9-4c64-9351-bc4f31f62d75 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:06.569812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82e7e5-0ea9-4c64-9351-bc4f31f62d75 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:06.571232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:06.577247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:06.577525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:06.577829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:06.620087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG passlib.handlers.bcrypt [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79956) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 16 16:42:06.620506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG passlib.handlers.bcrypt [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79956) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 16 16:42:06.668055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:06.669591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:06.672741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:06.673926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:06.749709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:06.767431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:06.772990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:06.789197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:06.867446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca78b5-59eb-4cc4-9c28-aaa72847e7ae None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:06.884305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180ba04-52db-47ea-9665-c2d101fb27b5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:06.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:06.900630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:06.900911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:06.901184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:06.911813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:06.915442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:06.916318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:06.916594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:06.916869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:06.922981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:06.923952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:06.924966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:06.929862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:06.979351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:06.980874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.022725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0132f-b2d5-4d78-808c-c0613734b70e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:07.054483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:07.055666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:07.055950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:07.056224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:07.056969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:07.057270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:07.058721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.070030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:07.073588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:42:07.078464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:07.078656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:07.179824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7aab6b-de3c-44ec-8c3c-4932f08bb2f5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:07.212914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:07.213814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:07.214100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:07.214371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:07.215573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:07.217046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.218701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:07 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:07.224010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:07.286512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edf28d-b2cd-4163-b0c2-309e3f20f3b4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:07.318968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:07.319129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0bc3e-0905-4f3a-a2bb-24b95a2b8c55 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:07.319755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:07.320038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:07.320312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:07.338689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:07.340168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.350758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:07.351539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:07.351816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:07.352087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:07.353254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:07.354726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.356321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 10/18] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:42:07.359753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:07.360693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:07.361567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:42:07.361567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:42:07.361567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:42:07.361567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:07.361567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 9/19] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:07.362258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:07.366995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:07.458580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efccfc-3a74-4822-b6fb-f4f91d120e26 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:07.462723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9b0e-f09d-440d-ac61-7fac57dbeb6d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:07.490447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:07.491095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:07.491376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:07.491649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:07.493076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.domain.id=default, user.id=f37f6f0cc485427c90ba2081965287a3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:07.493385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:07.494877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c29bd9-c537-4bdd-b97d-6e82200451bb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.495343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:07.495994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:07.496273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:07.496551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:07.497274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:07.497579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:07.499000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fafbc0-9ed0-45c4-b2cf-767a1189e1ae None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:07.501585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 11/20] 10.222.0.70 () {56 vars in 1322 bytes} [Mon May 16 16:42:07 2022] GET /identity/v3/role_assignments?user.id=f37f6f0cc485427c90ba2081965287a3&scope.domain.id=default&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:07.517222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 10/21] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:10.169895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba819722-fdeb-443b-9500-207394cf19ed None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.170417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba819722-fdeb-443b-9500-207394cf19ed None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.170417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba819722-fdeb-443b-9500-207394cf19ed None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.172049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 12/22] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:10.177631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.178513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.178999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.203446 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:10.204960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:10.244799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6b60-768f-46cb-b80f-5f85557b0d57 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.245421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6b60-768f-46cb-b80f-5f85557b0d57 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.245925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f6b60-768f-46cb-b80f-5f85557b0d57 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.247759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 13/23] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:10.253057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457294e-da27-4949-940e-7309126cea4c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.253339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457294e-da27-4949-940e-7309126cea4c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.253609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457294e-da27-4949-940e-7309126cea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.278510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0457294e-da27-4949-940e-7309126cea4c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:10.279872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0457294e-da27-4949-940e-7309126cea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:10.320338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 11/24] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:10.352526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 14/25] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:10.368984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:10.388627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457294e-da27-4949-940e-7309126cea4c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:10.506224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457294e-da27-4949-940e-7309126cea4c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:10.543644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:10.544676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.545121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.545540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.556459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:10.564255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:10.565253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:10.566225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:10.567971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4940d-4f9b-45c4-ba66-4792500372d0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:10.568327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 15/26] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:10.574107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:10.605458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:10.606568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.606985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.607394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.619188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:10.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:42:10.639148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:10.640172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:10.641129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:42:10.641129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:42:10.641129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:42:10.641129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:10.642960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 12/27] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:10.663786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:10.715305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a25cd-df30-4e53-ab82-ad2ade61552c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:10.761914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:10.762533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.762816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.763084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.763843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:10.764144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:10.765555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:10.784862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 16/28] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:10.792478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:10.875960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161c23f-8997-46b6-b5ba-f95906d68be9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:10.906335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59873940-3d5c-4af2-b1ea-13290ebfe0aa None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:10.944189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff52a4-a8fc-4e7e-830f-4c694e7adc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:10.945064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff52a4-a8fc-4e7e-830f-4c694e7adc0c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.945337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff52a4-a8fc-4e7e-830f-4c694e7adc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.945664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff52a4-a8fc-4e7e-830f-4c694e7adc0c None admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.947322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff52a4-a8fc-4e7e-830f-4c694e7adc0c None admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:10.948781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff52a4-a8fc-4e7e-830f-4c694e7adc0c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:10.950630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 17/29] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:10 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:10.954408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5c0bb-fb05-4bdd-bb9f-9319629ce3dc None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.955260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:10.955930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.956204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.956471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.957199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:10.957499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:10.958923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fc667-4660-4628-b375-8b5204f084b8 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:10.960486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5c0bb-fb05-4bdd-bb9f-9319629ce3dc None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.960774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5c0bb-fb05-4bdd-bb9f-9319629ce3dc None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:10.962839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 18/30] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:10.964248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5c0bb-fb05-4bdd-bb9f-9319629ce3dc None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:10.985193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 13/31] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:10.986664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:10.986952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:10.987224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.020085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:11.021215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:11.116998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5c0bb-fb05-4bdd-bb9f-9319629ce3dc None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:11.129767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 14/32] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:11.129767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:11.170562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945b351-5133-4fad-b7cf-99655b8ada03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:11.172073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945b351-5133-4fad-b7cf-99655b8ada03 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.172610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945b351-5133-4fad-b7cf-99655b8ada03 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.173071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945b351-5133-4fad-b7cf-99655b8ada03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.174482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945b351-5133-4fad-b7cf-99655b8ada03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:11.176174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945b351-5133-4fad-b7cf-99655b8ada03 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:11.182100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 19/33] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:11.183673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089f5f-ddda-448f-a3ce-db91178b90d1 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.184162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089f5f-ddda-448f-a3ce-db91178b90d1 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.184631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089f5f-ddda-448f-a3ce-db91178b90d1 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.190075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 20/34] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:11.191035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089f5f-ddda-448f-a3ce-db91178b90d1 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:11.252875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57909cee-e372-4039-be79-9cf829d3f627 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:11.295062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089f5f-ddda-448f-a3ce-db91178b90d1 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:11.296466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebd101-1245-4bc1-99f1-c1bacce1b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:11.297304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebd101-1245-4bc1-99f1-c1bacce1b81b None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.297584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebd101-1245-4bc1-99f1-c1bacce1b81b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.297880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebd101-1245-4bc1-99f1-c1bacce1b81b None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.299636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebd101-1245-4bc1-99f1-c1bacce1b81b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:11.301119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebd101-1245-4bc1-99f1-c1bacce1b81b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:11.332763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:11.333833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.334331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.334803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.335790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:11.338925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:11.446209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 15/35] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:11.446209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ebf3b-bd89-4009-a096-9ce458bdecbe None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.446209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ebf3b-bd89-4009-a096-9ce458bdecbe None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.446209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ebf3b-bd89-4009-a096-9ce458bdecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.459601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 21/36] 10.222.0.70 () {60 vars in 1131 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/roles => generated 219 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:11.460630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:11.480497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-806ebf3b-bd89-4009-a096-9ce458bdecbe None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:11.482157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-806ebf3b-bd89-4009-a096-9ce458bdecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:11.627558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 16/37] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:11.630186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc0c5-37e7-483c-9848-31b38187fa7a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.630466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc0c5-37e7-483c-9848-31b38187fa7a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.630743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc0c5-37e7-483c-9848-31b38187fa7a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.632150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 17/38] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:11.639703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.640024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.640187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.678724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5498fc-62ed-433e-aebd-e55f8e16e116 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:11.682496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:11.683804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:11.735113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:11.736079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.736365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.736651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] PATH_INFO: `/v3/domains/default/users/f37f6f0cc485427c90ba2081965287a3/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.739554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f37f6f0cc485427c90ba2081965287a3, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:11.741257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:11.765769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 22/39] 10.222.0.70 () {58 vars in 1361 bytes} [Mon May 16 16:42:11 2022] PUT /identity/v3/domains/default/users/f37f6f0cc485427c90ba2081965287a3/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:11.765769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:11.777577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 18/40] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:11.814635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:11.896138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e4c1d-d23e-41bb-bbc1-48f1f539a337 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:11.939470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340c3ff-aaff-4f24-84e8-c7b56bd80e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:11.940164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340c3ff-aaff-4f24-84e8-c7b56bd80e63 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.940447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340c3ff-aaff-4f24-84e8-c7b56bd80e63 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.940722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340c3ff-aaff-4f24-84e8-c7b56bd80e63 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.941484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340c3ff-aaff-4f24-84e8-c7b56bd80e63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:11.942966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340c3ff-aaff-4f24-84e8-c7b56bd80e63 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:11.955860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33005f3-8cfc-4889-a3fd-887d22419480 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:11.961949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 23/41] 10.222.0.70 () {60 vars in 1131 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:11.961949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461e00-af26-4c5e-9710-506ab6125937 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.961949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461e00-af26-4c5e-9710-506ab6125937 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.961949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461e00-af26-4c5e-9710-506ab6125937 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.961949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 24/42] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:11.968694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.968976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.969295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:11.991488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:11.993136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:11.998593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:11.999340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:11.999623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:11.999899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:12.000675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:12.002396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:12.019394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 19/43] 10.222.0.70 () {60 vars in 1131 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:42:12.083397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 25/44] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:12.107702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:12.226500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb91754-facf-4d69-bf86-0903a62eb1fa None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:12.261920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb901c-9c9a-48f3-942a-6f29f7ec41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:12.262747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb901c-9c9a-48f3-942a-6f29f7ec41a4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:12.263054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb901c-9c9a-48f3-942a-6f29f7ec41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:12.263327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb901c-9c9a-48f3-942a-6f29f7ec41a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:12.264487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb901c-9c9a-48f3-942a-6f29f7ec41a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:12.265999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb901c-9c9a-48f3-942a-6f29f7ec41a4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:12.267947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 20/45] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:12.273429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:12.369856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e620c53-9203-409b-bdc6-df776e4b35d7 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:12.401793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a26ad2-b192-47d7-aea8-142139c168a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:12.402446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26ad2-b192-47d7-aea8-142139c168a0 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:12.402723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26ad2-b192-47d7-aea8-142139c168a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:12.402993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26ad2-b192-47d7-aea8-142139c168a0 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:12.403702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a26ad2-b192-47d7-aea8-142139c168a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:12.405291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a26ad2-b192-47d7-aea8-142139c168a0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:12.433381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 26/46] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:42:12 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:14.145034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdba52-64e6-4f95-b21d-f745a6c22f9a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.145557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdba52-64e6-4f95-b21d-f745a6c22f9a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.145662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdba52-64e6-4f95-b21d-f745a6c22f9a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.147084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 21/47] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:14.153032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.153454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.153589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.170556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:14.171731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:14.239927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 27/48] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:14.263475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdba52-64e6-4f95-b21d-f745a6c22f9a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.359161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdba52-64e6-4f95-b21d-f745a6c22f9a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:14.391276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:14.392064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.392348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.392624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.403881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:14.412526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:14.413427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:14.414747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 22/49] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:14.420171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.522673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774b652-f613-43bb-826f-9969333d1b98 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:14.562765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:14.563430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.563713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.563984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.564729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:14.565032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:14.566464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85635-6341-4a95-829e-24b7d67bacbe None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:14.574310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 28/50] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:14.579875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.654641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfc54-9a31-4714-aaf4-85d19c1871ba None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.654851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfc54-9a31-4714-aaf4-85d19c1871ba None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.655126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfc54-9a31-4714-aaf4-85d19c1871ba None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.656482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 29/51] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:14.661205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.661492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.661790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.677345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b454-ae58-4591-805d-03b6ddbe293f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:14.677964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:14.679126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:14.709031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:14.709930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.710215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.710489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.712417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:14.713904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:14.715567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 23/52] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:14 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:14.720997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.741585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 30/53] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:14.763557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.813787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2a78e-7515-4ba3-8e04-6c8fcd419a51 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:14.846082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:14.846897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.847171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.848496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.849677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:14.851172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:14.854524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 24/54] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:14.861810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.861969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489e875-5b69-4aa7-b5ad-fecd63a030c0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:14.900943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:14.901759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:14.902152 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:14.902431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:14.903598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:14.905092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:14.907722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 31/55] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:14.914766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:14.968701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2f46-e0c6-4e63-a7a6-faa5acadb92a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:15.000245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:15.000900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:15.001175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:15.001447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:15.002295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.domain.id=default, user.id=f37f6f0cc485427c90ba2081965287a3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:15.002601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:15.004042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea385a-1d18-44a0-847d-53c3d740135b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:15.008601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85cbcd-c695-4b89-ac8e-a28e009e6704 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:15.012449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 25/56] 10.222.0.70 () {56 vars in 1322 bytes} [Mon May 16 16:42:14 2022] GET /identity/v3/role_assignments?user.id=f37f6f0cc485427c90ba2081965287a3&scope.domain.id=default&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:15.042397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4678d91-8b08-49b5-a38d-f78fb2ef0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:15.043076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678d91-8b08-49b5-a38d-f78fb2ef0fa3 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:15.043356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678d91-8b08-49b5-a38d-f78fb2ef0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:15.043625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4678d91-8b08-49b5-a38d-f78fb2ef0fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:15.044353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4678d91-8b08-49b5-a38d-f78fb2ef0fa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:15.045870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4678d91-8b08-49b5-a38d-f78fb2ef0fa3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:15.073681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 32/57] 10.222.0.70 () {60 vars in 1140 bytes} [Mon May 16 16:42:14 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:42:17.302532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2bbd-bedc-49c5-b9a0-b145d3f8ac2b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:17.303061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2bbd-bedc-49c5-b9a0-b145d3f8ac2b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:17.303061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b2bbd-bedc-49c5-b9a0-b145d3f8ac2b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:17.304450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 26/58] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:17.310246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:17.310667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:17.310799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:17.326988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:17.328145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:17.389857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 33/59] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:17.413483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2bbd-bedc-49c5-b9a0-b145d3f8ac2b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:17.509318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b2bbd-bedc-49c5-b9a0-b145d3f8ac2b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:17.540342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6228e14-950a-4fe1-85ff-599b9cb67bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:17.541121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6228e14-950a-4fe1-85ff-599b9cb67bfe None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:17.541399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6228e14-950a-4fe1-85ff-599b9cb67bfe None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:17.541674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6228e14-950a-4fe1-85ff-599b9cb67bfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:17.542851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6228e14-950a-4fe1-85ff-599b9cb67bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:17.544298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6228e14-950a-4fe1-85ff-599b9cb67bfe None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:17.545934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 27/60] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:17.551453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:17.642983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c195840-d63f-46de-9be1-bcd2e44198ef None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:17.675757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c593f-490c-4d4b-b51c-4ebbd11443da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:17.676407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c593f-490c-4d4b-b51c-4ebbd11443da None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:17.676685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c593f-490c-4d4b-b51c-4ebbd11443da None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:17.676958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c593f-490c-4d4b-b51c-4ebbd11443da None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:17.677907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c593f-490c-4d4b-b51c-4ebbd11443da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:17.679362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c593f-490c-4d4b-b51c-4ebbd11443da None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:17.704004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 34/61] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:17 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:21.031695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb01b1-e977-4a50-865b-2ade5f0ae11a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.032714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb01b1-e977-4a50-865b-2ade5f0ae11a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.033243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb01b1-e977-4a50-865b-2ade5f0ae11a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.035106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 28/62] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:21.040853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.041670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.042180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.066726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:21.068276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:21.148129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4f3d4-77a3-4250-b800-09759e3823db None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.149323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4f3d4-77a3-4250-b800-09759e3823db None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.149816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4f3d4-77a3-4250-b800-09759e3823db None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.151631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 29/63] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:21.157307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.157927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.158400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.161612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 35/64] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:21.177580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:21.179290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:21.199493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.307849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8852-dfc2-488d-b922-e372c43dd6d7 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.339499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 30/65] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:21.344531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.345524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.345969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.346397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.356846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:21.364884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:21.365908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:21.367448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:21.369353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 36/66] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:21.375314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.375443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.483267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1a4f0-173c-4f3b-84ab-23fdb72f4234 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.506662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c4dc2-3b8b-4554-be19-95c27b446b25 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.521695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.522613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.523036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.523484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.524408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:21.524960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:21.526674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e1504-8762-4339-8cb9-bea5ccf721f1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:21.535779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 37/67] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:21.537390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac9e07-ef0f-433d-a40f-d6949c7e7c54 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.537878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac9e07-ef0f-433d-a40f-d6949c7e7c54 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.538295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac9e07-ef0f-433d-a40f-d6949c7e7c54 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.540111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 38/68] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:21.541153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac9e07-ef0f-433d-a40f-d6949c7e7c54 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.549638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9accaa1-3402-4028-9603-483f19f2f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.550795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9accaa1-3402-4028-9603-483f19f2f038 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.551226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9accaa1-3402-4028-9603-483f19f2f038 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.551645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9accaa1-3402-4028-9603-483f19f2f038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.564327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9accaa1-3402-4028-9603-483f19f2f038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b9accaa1-3402-4028-9603-483f19f2f038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:21.573437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:21.574400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:21.575160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:21.582060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 31/69] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:21.582060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.582060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.582335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.601666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:21.603152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:21.661599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac9e07-ef0f-433d-a40f-d6949c7e7c54 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.685762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 32/70] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:21.685762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.706258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ecae-5b9e-40d6-b9ef-7a1d3fe79649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.707130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ecae-5b9e-40d6-b9ef-7a1d3fe79649 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.707415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ecae-5b9e-40d6-b9ef-7a1d3fe79649 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.707673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ecae-5b9e-40d6-b9ef-7a1d3fe79649 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.721500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ecae-5b9e-40d6-b9ef-7a1d3fe79649 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:21.723085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ecae-5b9e-40d6-b9ef-7a1d3fe79649 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:21.725009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 39/71] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:21.728268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73b7e-966e-44e5-be26-8ca7cbfbe8d4 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.729046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73b7e-966e-44e5-be26-8ca7cbfbe8d4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.729540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73b7e-966e-44e5-be26-8ca7cbfbe8d4 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.731652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 40/72] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:21.732563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73b7e-966e-44e5-be26-8ca7cbfbe8d4 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.782267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a783ed-4902-42ca-8397-bd75859a6ea4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.814866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.815477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.816009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.816742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:21.817042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:21.818459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:21.827385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73b7e-966e-44e5-be26-8ca7cbfbe8d4 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.829223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 33/73] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:21.830049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:21.864302 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c3795-07cf-46b7-ba25-47cd83e4be17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.865089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c3795-07cf-46b7-ba25-47cd83e4be17 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.865369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c3795-07cf-46b7-ba25-47cd83e4be17 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.865639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c3795-07cf-46b7-ba25-47cd83e4be17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.875824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c3795-07cf-46b7-ba25-47cd83e4be17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-712c3795-07cf-46b7-ba25-47cd83e4be17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:21.883367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:21.884371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:21.885223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 41/74] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:21.886019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ae36-71e7-450e-809a-2e0db95ea9dc None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.886129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ae36-71e7-450e-809a-2e0db95ea9dc None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.886408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92ae36-71e7-450e-809a-2e0db95ea9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.903290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1c92ae36-71e7-450e-809a-2e0db95ea9dc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:21.904447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1c92ae36-71e7-450e-809a-2e0db95ea9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:21.925306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebbd6-a3c5-4a64-91d9-507271d34fe1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:21.956399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1af720-ead1-4dd7-ae46-37db5ddca5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:21.957038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1af720-ead1-4dd7-ae46-37db5ddca5a0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.957313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1af720-ead1-4dd7-ae46-37db5ddca5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.957585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1af720-ead1-4dd7-ae46-37db5ddca5a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.965986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 42/75] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:21.967277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc666-d12b-4206-bc80-9b9946315b56 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:21.967562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc666-d12b-4206-bc80-9b9946315b56 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:21.967832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc666-d12b-4206-bc80-9b9946315b56 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:21.969079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 43/76] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:21.969786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bc666-d12b-4206-bc80-9b9946315b56 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.021989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1af720-ead1-4dd7-ae46-37db5ddca5a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.023449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1af720-ead1-4dd7-ae46-37db5ddca5a0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.067665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bc666-d12b-4206-bc80-9b9946315b56 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.098628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.099479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.099755 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.100023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.101181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.103223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.104831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 44/77] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.105580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.118480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 34/78] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:22.118480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.118480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.118480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.132883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:22.134093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:22.195607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 35/79] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:22.196426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.200475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560b754-ed75-4b9e-ba9d-0436a3863474 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.233828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.234517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.234800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.235075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.235820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:22.236122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.237506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.245456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 45/80] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.246272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.287959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded68b53-69c8-4c16-9ecf-5dfb828aabc6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.319575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.320325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.320604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.320877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.330451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:22.337148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c056b-f2f0-45df-86ae-70cab4a8952d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:22.338494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:22.339337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:22.340181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 36/81] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:22.340803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.372905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.373542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.373843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.374122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.436769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.438289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.440321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3983aa-0bdf-42b3-b0ae-ac40eff54759 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.471936 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.472777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.473056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.473326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.474528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.475981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.477698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 37/82] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.478477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.536488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 46/83] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:22.536488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.573896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a064-b37e-40e9-87e5-9835372e1bd2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.604805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.605582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.605893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.606164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.607323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.608769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.610555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 38/84] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.611144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.627480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606971-9c14-4c85-bb48-31316f0f532d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.659212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.660069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.660342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.660610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.661813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.663330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.664962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 47/85] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.665713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.702101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc29f83-c176-430d-8f3b-9a7b2aed58f5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.733134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.733820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.734099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.734370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.735097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:22.735397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.736761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.744584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 39/86] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.745416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.756563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dd379-e2c6-447f-8fa8-1bbe1af01c1b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.789169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.789848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.790133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.790413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.791246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=052dcf7b71fa4cc0848daec5968ebb09) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:22.791560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.793000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.798253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 48/87] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/role_assignments?user.id=052dcf7b71fa4cc0848daec5968ebb09&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.799009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.841355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49a55-81ce-447f-b9b5-3f248a3bd2bc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.876341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.877228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.877511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.877823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.879316 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.880761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.882770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 40/88] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:22.883958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.910502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd611e-2ca6-435c-92c2-d93f1b67d75a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:22.949442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:22.950157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:22.950438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:22.950712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:22.951432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:22.952898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:22.976148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 49/89] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:22 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:22.977228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:22.996284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51845644-cde5-4cfd-b104-afb363fd925b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.032900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.033563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.033879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.034160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.111633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.113097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.133125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335e668-a4a1-450d-ac0e-da128a795374 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.188683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.190630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.191423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.192182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.194487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.197977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.201060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 50/90] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:23.202681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:23.218584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 41/91] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:23.219476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:23.332666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd1cd-6eec-44eb-bc78-9cf0c75dd4ab None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.340662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0552649-c7bd-4854-b886-597eb9d4f0d8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.374308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.375392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.375894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.376378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.378651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.379145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.379430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.379702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.380598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] RBAC: Adding query filter params (role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=052dcf7b71fa4cc0848daec5968ebb09) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:23.380912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.384600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.390607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 51/92] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:23 2022] GET /identity/v3/role_assignments?user.id=052dcf7b71fa4cc0848daec5968ebb09&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:23.391447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:23.470849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.472782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.525034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff0604-3822-4848-9020-e1bd242a7807 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.563556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.564808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.565294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.565828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.567757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.570203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.572648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 52/93] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:23 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:23.578568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:23.600795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 42/94] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:23.609839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:23.704312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d752d-18d6-4de0-8047-9b68fd089297 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.740179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.740841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.741124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.741401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.742331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=f37f6f0cc485427c90ba2081965287a3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:23.742651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.744115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.750403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 53/95] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:23 2022] GET /identity/v3/role_assignments?user.id=f37f6f0cc485427c90ba2081965287a3&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:23.757518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b701c4-642a-44ae-abf5-3538253bd75a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.797394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e827-9352-4d80-b017-e8b604a77cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.798352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e827-9352-4d80-b017-e8b604a77cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.798629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e827-9352-4d80-b017-e8b604a77cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.798949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e827-9352-4d80-b017-e8b604a77cc3 None admin] PATH_INFO: `/v3/projects/16d0395301484d17bef5c7a87f5e46c8` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.800156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1e827-9352-4d80-b017-e8b604a77cc3 None admin] RBAC: Authorizing `identity:get_project(project_id=16d0395301484d17bef5c7a87f5e46c8)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.801601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1e827-9352-4d80-b017-e8b604a77cc3 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.803764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 43/96] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:23 2022] GET /identity/v3/projects/16d0395301484d17bef5c7a87f5e46c8 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:23.809314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:23.926699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7813a02-e8b9-4556-aeea-1f243265de9a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:23.965061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:23.965650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:23.965967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:23.966246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:23.967090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=16d0395301484d17bef5c7a87f5e46c8, user.id=052dcf7b71fa4cc0848daec5968ebb09) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:23.967404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:23.968885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6ae7-b323-4f13-91dd-0aa4bb132b2d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:23.975264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 54/97] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:23 2022] GET /identity/v3/role_assignments?user.id=052dcf7b71fa4cc0848daec5968ebb09&scope.project.id=16d0395301484d17bef5c7a87f5e46c8&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:25.663546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb3a9-1e21-46ba-9144-29017d4fdd24 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:25.664826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb3a9-1e21-46ba-9144-29017d4fdd24 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:25.664826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb3a9-1e21-46ba-9144-29017d4fdd24 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:25.666594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 44/98] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:25.676157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:25.676601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:25.676779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:25.697880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:25.699075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:25.786502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 55/99] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:25.820896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb3a9-1e21-46ba-9144-29017d4fdd24 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:25.937878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb3a9-1e21-46ba-9144-29017d4fdd24 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:25.981323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:25.982540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:25.983017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:25.983479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:25.998383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:26.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:26.007144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:26.008080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:26.013829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 45/100] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:26.016130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:26.123032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49cd9b-dffe-418f-9c07-115a6ded7966 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:26.156483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:26.157500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.158002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.158467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.159419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:26.159928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:26.161494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:26.170994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 56/101] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:26.176258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:26.288004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70ab48-a7f3-478f-a3d2-a74612a5731b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:26.339975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8ab6-43f6-4685-a06d-c422e04262c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:26.341218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8ab6-43f6-4685-a06d-c422e04262c6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.341689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8ab6-43f6-4685-a06d-c422e04262c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.342182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8ab6-43f6-4685-a06d-c422e04262c6 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.343828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa8ab6-43f6-4685-a06d-c422e04262c6 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:26.345624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa8ab6-43f6-4685-a06d-c422e04262c6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:26.347508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 46/102] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:26 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:26.353574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:26.458956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141865b-54d2-49d0-ac5c-20d7b7f752cc None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:26.465899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be53d-e1ab-4f97-8c85-429c3a6858e6 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.466219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be53d-e1ab-4f97-8c85-429c3a6858e6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.466464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391be53d-e1ab-4f97-8c85-429c3a6858e6 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.467964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 47/103] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:26.473002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.473282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.473550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.502692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:26.503875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:26.522507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:26.523578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.523854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.524120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.526673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:26.528228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:26.530946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 57/104] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:26 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:26.537399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:26.641650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 48/105] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:26.677828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:26.720420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd034c-76de-4370-9f8d-f32babf0c9e0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:26.785407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:26.786334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.786610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.786882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/052dcf7b71fa4cc0848daec5968ebb09/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.792516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb3030e3ef945a6a8787c4f1023bd8a, user_id=052dcf7b71fa4cc0848daec5968ebb09, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:26.793994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:26.823580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 58/106] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:26 2022] PUT /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/052dcf7b71fa4cc0848daec5968ebb09/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:42:26.847514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee4a0a-58e9-469d-908f-2aff93fcbeee None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:26.892067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d219ee-03ff-42a4-bce9-ea3ba97f1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:26.892816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d219ee-03ff-42a4-bce9-ea3ba97f1815 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:26.893146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d219ee-03ff-42a4-bce9-ea3ba97f1815 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:26.893428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d219ee-03ff-42a4-bce9-ea3ba97f1815 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:26.896920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d219ee-03ff-42a4-bce9-ea3ba97f1815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:26.899097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d219ee-03ff-42a4-bce9-ea3ba97f1815 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:26.901046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 49/107] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:26.906418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:27.037939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b4622-bc9c-43af-a48d-6ea1bc7b12d8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:27.084313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6e9e-9e00-4b4d-8177-46543343f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:27.084986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6e9e-9e00-4b4d-8177-46543343f2fe None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.085264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6e9e-9e00-4b4d-8177-46543343f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.085564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6e9e-9e00-4b4d-8177-46543343f2fe None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.086937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6e9e-9e00-4b4d-8177-46543343f2fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:27.088984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6e9e-9e00-4b4d-8177-46543343f2fe None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:27.111042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6256-c4ed-437e-b995-df585f562018 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.111658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6256-c4ed-437e-b995-df585f562018 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.112182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6256-c4ed-437e-b995-df585f562018 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.114082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 50/108] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:27.120354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699735b-0c03-4e58-9fcb-bc505d24e556 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.121041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699735b-0c03-4e58-9fcb-bc505d24e556 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.121522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699735b-0c03-4e58-9fcb-bc505d24e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.150667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 59/109] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:42:26 2022] POST /identity/v3/projects => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:27.153916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0699735b-0c03-4e58-9fcb-bc505d24e556 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:27.155225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0699735b-0c03-4e58-9fcb-bc505d24e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:27.251978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 51/110] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:27.262554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c141bf-0e5d-44d4-926e-57dfaf89cc2d None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.263246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c141bf-0e5d-44d4-926e-57dfaf89cc2d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.263715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c141bf-0e5d-44d4-926e-57dfaf89cc2d None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.265571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 60/111] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:27.272195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037c7eb-d9b5-462b-9a59-578fbe5c21b7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.272508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037c7eb-d9b5-462b-9a59-578fbe5c21b7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.272766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037c7eb-d9b5-462b-9a59-578fbe5c21b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.298419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7037c7eb-d9b5-462b-9a59-578fbe5c21b7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:27.299639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7037c7eb-d9b5-462b-9a59-578fbe5c21b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:27.306694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c141bf-0e5d-44d4-926e-57dfaf89cc2d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:27.438461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c141bf-0e5d-44d4-926e-57dfaf89cc2d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:27.443338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 52/112] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:27.444709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c441e-8428-4853-8428-bb74c5c17bf9 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.445058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c441e-8428-4853-8428-bb74c5c17bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.445341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c441e-8428-4853-8428-bb74c5c17bf9 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.446801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 53/113] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:27.454016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eed8a-e806-4060-9bed-5683e8ae6574 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.454306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eed8a-e806-4060-9bed-5683e8ae6574 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.454592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eed8a-e806-4060-9bed-5683e8ae6574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.478148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:27.478964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.479239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.479536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.486403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-445eed8a-e806-4060-9bed-5683e8ae6574 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:27.487594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-445eed8a-e806-4060-9bed-5683e8ae6574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:27.496207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:27.505193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:27.506159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:27.506934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 61/114] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:27.507593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:27.586408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 54/115] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:27.591614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c8de-a073-4967-95ef-5cd4aea38423 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.592180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c8de-a073-4967-95ef-5cd4aea38423 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.592801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8c8de-a073-4967-95ef-5cd4aea38423 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.594523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 55/116] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:27.595461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c8de-a073-4967-95ef-5cd4aea38423 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:27.660617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a6ae8-890c-4229-b425-788f398dc614 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:27.703150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdf019-19fd-4a10-a966-e572134ec314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:27.703849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf019-19fd-4a10-a966-e572134ec314 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.704135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf019-19fd-4a10-a966-e572134ec314 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.704398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf019-19fd-4a10-a966-e572134ec314 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.717658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdf019-19fd-4a10-a966-e572134ec314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-80cdf019-19fd-4a10-a966-e572134ec314 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:27.732036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:27.733353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:27.734173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 62/117] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:27.735319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.735319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.735580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.738839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8c8de-a073-4967-95ef-5cd4aea38423 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:27.765186 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:27.767314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:27.781095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:27.782171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.782644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.783235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.784227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:27.784978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:27.787729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:27.797928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 56/118] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:27.799416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:27.848407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 63/119] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:27.849493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:27.917959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c298272-c40c-4d04-afe2-1e7b33e148b9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:27.961369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:27.962383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:27.962383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:27.962654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:27.972481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5d2e-12ca-40a2-a268-47c6eb714f19 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:27.972752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:27.981247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:27.982145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:27.982889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 57/120] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:27.983506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.013346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.014116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.014397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.014670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.015725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:28.015829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.017164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.025395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 64/121] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.026511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.100736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf73a6-d197-445e-a691-42cf2cc557ea None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.134190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.135064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.135346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.135621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] PATH_INFO: `/v3/users/e4e528e838ba41aca4d512293626fae3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.140973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ffc75-5e47-47da-bd15-2e866c95dba0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.151991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=e4e528e838ba41aca4d512293626fae3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.153555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.155139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 58/122] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:27 2022] GET /identity/v3/users/e4e528e838ba41aca4d512293626fae3 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.155988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.181705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.183168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.183799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.184594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.197050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:28.207868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:28.208882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:28.209832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:28.212428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 65/123] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:28.213866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.261732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad80c9-aa8d-4692-bbdb-815919da1ed4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.296470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.297293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.297669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.298067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.298928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:28.299332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.300923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.311958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 59/124] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.312942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.336115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84a9d1-9c65-42b5-a8ec-88815e7f1d48 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.369614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.370938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.371303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.371676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.373317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.375162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.377083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 66/125] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.378034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.436200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b35f2f-ede8-4970-9d9c-4722772b061a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.479981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.480865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.481284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.481470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a6cab-7a8c-4e89-ad63-4fd5cb76ffc9 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.481864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.515763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.516483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.516770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.517049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.517894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:28.518203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.519584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.528079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 67/126] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.528954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.573520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.577623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.633006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba7d43-38b7-4c78-a6f8-6a3794d4d75d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.675899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.677021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.677437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.677909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.680010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.681601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.683396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 68/127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.684306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.690970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 60/128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:28.691934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.782706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78509f-7448-41e0-b758-1b4bd567e88d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.796676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e5fa-9bcc-4628-93df-15fa7c36ba23 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.817016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.818223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.818704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.819181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] PATH_INFO: `/v3/projects/16d0395301484d17bef5c7a87f5e46c8` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.820577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] RBAC: Authorizing `identity:get_project(project_id=16d0395301484d17bef5c7a87f5e46c8)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.822269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.824165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 69/129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/projects/16d0395301484d17bef5c7a87f5e46c8 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.825116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.831646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.832575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.832856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.833180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.834621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.836692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.838668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 61/130] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.839453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.925460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e679f1-0add-43a2-afaa-3a3eea14cf6d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.939454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abac00-aeae-4ce2-b979-a6605019a146 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:28.958433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.959634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.960112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.961134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.962533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.964194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.966150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 70/131] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.967136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:28.974041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:28.974938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:28.975222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:28.975500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:28.977427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:28.979217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:28.981249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 62/132] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:28.985901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:29.076084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b673-7805-4e4a-a214-662f492844b6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:29.090136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dfa37-59fe-4e53-bc24-0137b5feecd6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:29.110636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:29.111855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.112337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.112805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] PATH_INFO: `/v3/projects/16d0395301484d17bef5c7a87f5e46c8/users/052dcf7b71fa4cc0848daec5968ebb09/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.115253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] RBAC: Authorizing `identity:create_grant(project_id=16d0395301484d17bef5c7a87f5e46c8, user_id=052dcf7b71fa4cc0848daec5968ebb09, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:29.116956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:29.125618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:29.126609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.126891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.127237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.128459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:29.130098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:29.132053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 63/133] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:28 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:29.133040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:29.135132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 71/134] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:28 2022] PUT /identity/v3/projects/16d0395301484d17bef5c7a87f5e46c8/users/052dcf7b71fa4cc0848daec5968ebb09/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:29.136474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:29.246932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3584a-1228-453a-80b9-021796e6bbe6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:29.266426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0014b3-2ba8-408a-8a60-df18d5f22f62 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:29.286440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:29.287529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.287918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.288494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/f37f6f0cc485427c90ba2081965287a3/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.291294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb3030e3ef945a6a8787c4f1023bd8a, user_id=f37f6f0cc485427c90ba2081965287a3, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:29.293267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:29.316395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 64/135] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:29 2022] PUT /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/f37f6f0cc485427c90ba2081965287a3/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:29.317413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:29.326716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:29.327333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.327620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.327901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.328787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] RBAC: Adding query filter params (role.id=f12236030bf24b378a9e62e20138a0aa, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=e4e528e838ba41aca4d512293626fae3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:29.329100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:29.330657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a356d1a-5fcb-4969-a9d4-2340de612921 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:29.340797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 72/136] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:29 2022] GET /identity/v3/role_assignments?user.id=e4e528e838ba41aca4d512293626fae3&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=f12236030bf24b378a9e62e20138a0aa => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:29.518149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4402fa-3e2d-4223-b517-ec2c15c5f6f6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:29.558655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c427-b0db-4f9c-a75c-86906b3fee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:29.559600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c427-b0db-4f9c-a75c-86906b3fee64 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.559878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c427-b0db-4f9c-a75c-86906b3fee64 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.560154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c427-b0db-4f9c-a75c-86906b3fee64 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/052dcf7b71fa4cc0848daec5968ebb09/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.563929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31c427-b0db-4f9c-a75c-86906b3fee64 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb3030e3ef945a6a8787c4f1023bd8a, user_id=052dcf7b71fa4cc0848daec5968ebb09, role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:29.565500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31c427-b0db-4f9c-a75c-86906b3fee64 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:29.593688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 65/137] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:29 2022] PUT /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/052dcf7b71fa4cc0848daec5968ebb09/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:29.778041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab89df-581e-4f4b-a8ec-dfbb9801c105 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.778425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab89df-581e-4f4b-a8ec-dfbb9801c105 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.778606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab89df-581e-4f4b-a8ec-dfbb9801c105 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.780026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 73/138] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:29.786110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.786442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.786665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.806081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:29.807059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:29.811540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3cdad-3e6f-4d5f-9c8f-501af277cce4 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.811996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3cdad-3e6f-4d5f-9c8f-501af277cce4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.812176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3cdad-3e6f-4d5f-9c8f-501af277cce4 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.813526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 74/139] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:29.819765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:29.820648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:29.820931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:29.841879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:29.843834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:29.923387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 75/140] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:29.923682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 66/141] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:29.965588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:30.019247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:30.083865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dd775-0b01-4499-a897-43cee4f1deb7 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:30.123782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:30.125023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:30.125317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:30.125597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:30.126952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:30.128592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:30.130456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 76/142] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:30.136727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:30.222396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69ad4-760d-4f58-8e1a-054195ee8319 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:30.249481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002961a3-f93e-427a-85a3-98f73c66f4f1 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:30.256473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:30.258083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:30.258592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:30.259066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:30.269789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:30.278287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:30.279184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:30.279979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:30.282733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 67/143] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:30.290350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:30.291027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:30.291226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:30.291507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:30.291837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:30.292603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:30.294359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:30.316203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 77/144] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:30 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:42:30.466179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ae7e-57c9-4c81-8110-983f1b2203cc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:30.502126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:30.503196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:30.503676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:30.504143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:30.505110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:30.505608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:30.507240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:30.516606 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 68/145] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:30.523468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:30.638840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353e44-8bc3-4253-beb0-e3be8c769e0e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:30.681268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:30.682161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:30.682438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:30.682708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:30.684599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:30.686553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:30.688598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 78/146] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:30 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:30.693808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:30.829423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53babb2-35f3-4f88-b528-f7e10935f490 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:30.872783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:30.873853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:30.874335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:30.874822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:30.949322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:30.951217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:31.053726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 69/147] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:31.059529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:31.183105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9a6af-1fe4-4886-b6f5-ac75d92247c7 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:31.222616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c17d9-5a42-46c9-9c8c-07da1eb4ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:31.223465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c17d9-5a42-46c9-9c8c-07da1eb4ab81 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:31.223746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c17d9-5a42-46c9-9c8c-07da1eb4ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:31.224022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c17d9-5a42-46c9-9c8c-07da1eb4ab81 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:31.226962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c17d9-5a42-46c9-9c8c-07da1eb4ab81 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:31.228449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c17d9-5a42-46c9-9c8c-07da1eb4ab81 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:31.230233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 79/148] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:31 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:31.238172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:31.351406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de500fa-721f-4cfa-b001-aa2f81459b37 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:31.401277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:31.402366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:31.402846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:31.403335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:31.404368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=052dcf7b71fa4cc0848daec5968ebb09) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:31.404876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:31.416293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6976e-17d7-4d25-aa1a-68073d4ffb1e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:31.423540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 70/149] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:31 2022] GET /identity/v3/role_assignments?user.id=052dcf7b71fa4cc0848daec5968ebb09&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:32.834043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd22b3-d312-4d0a-a2d7-395e966b849d None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:32.834584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd22b3-d312-4d0a-a2d7-395e966b849d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:32.834969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd22b3-d312-4d0a-a2d7-395e966b849d None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:32.836395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 80/150] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:32.841937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1d4a-94c3-40fd-9084-ed4e20fb24c8 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:32.842363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1d4a-94c3-40fd-9084-ed4e20fb24c8 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:32.842532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1d4a-94c3-40fd-9084-ed4e20fb24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:32.850115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad9c5-7cf1-4f81-8d31-471a7aba4feb None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:32.850397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad9c5-7cf1-4f81-8d31-471a7aba4feb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:32.850674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ad9c5-7cf1-4f81-8d31-471a7aba4feb None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:32.852073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 81/151] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:32.858205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:32.858485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:32.858760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:32.890947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-715f1d4a-94c3-40fd-9084-ed4e20fb24c8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:32.892186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-715f1d4a-94c3-40fd-9084-ed4e20fb24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:32.905404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:32.906670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:33.016873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 71/152] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:33.018322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7ca3-65e6-4580-b9d7-3e1891f69abc None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.018614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7ca3-65e6-4580-b9d7-3e1891f69abc None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.018894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7ca3-65e6-4580-b9d7-3e1891f69abc None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.020251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 72/153] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:33.035665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.035994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.036225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.043366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 82/154] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:33.059168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.062850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:33.068786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:33.203808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c7ca5-1437-4ae9-9f41-fd9251a738e4 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:33.236199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 73/155] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:33.237089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.241135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:33.242277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.243570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.244066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.255635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:33.265422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:33.266321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:33.267081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:33.269455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 83/156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:33.275863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.361343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de5a2a-d1c8-42e8-8654-7bfe15c0170e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:33.440493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ea1b-2d79-4b5c-a7d8-6abb30577e5e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:33.448366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:33.449173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.449453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.449728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.472747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:33.482073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:33.482896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:33.483660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 74/157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:33.484429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.500123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:33.501006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.501423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.501866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.502749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:33.503211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:33.504741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dced90-f1b1-4eb1-812a-677ae147c1d4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:33.521183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 84/158] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:33.525778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca12d7-6bb8-42de-ae5f-d9f1802044e0 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.526228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca12d7-6bb8-42de-ae5f-d9f1802044e0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.526655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca12d7-6bb8-42de-ae5f-d9f1802044e0 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.530083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 85/159] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:33.530950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca12d7-6bb8-42de-ae5f-d9f1802044e0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.643680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca12d7-6bb8-42de-ae5f-d9f1802044e0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:33.658019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f5094-0513-4368-80ca-edb973b5f6d4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:33.680442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:33.681388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.681857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.682272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.683208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:33.683699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:33.685319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:33.695907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 86/160] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:33.697219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.727508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aad1a-a843-4611-813d-30468993df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:33.728253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aad1a-a843-4611-813d-30468993df9b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.728540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aad1a-a843-4611-813d-30468993df9b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.728818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aad1a-a843-4611-813d-30468993df9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.749704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aad1a-a843-4611-813d-30468993df9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-4c9aad1a-a843-4611-813d-30468993df9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:33.758659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:33.759813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:33.760850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:33.765231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 75/161] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:33.766430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.766711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.766982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.806776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:33.807972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:33.813249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90774914-0dd8-4d4d-bfb3-6cff6c5e5e54 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:33.848150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:33.849728 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:33.850170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:33.850594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] PATH_INFO: `/v3/users/f37f6f0cc485427c90ba2081965287a3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:33.852028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] RBAC: Authorizing `identity:get_user(user_id=f37f6f0cc485427c90ba2081965287a3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:33.853724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:33.859793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 87/162] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/users/f37f6f0cc485427c90ba2081965287a3 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:33.860827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.963636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 76/163] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:33.965205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:33.996889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2654-d2b3-4ae3-be65-6427ddfa8f02 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.031530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.032723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.033139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.033580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] PATH_INFO: `/v3/users/e4e528e838ba41aca4d512293626fae3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.034935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e4e528e838ba41aca4d512293626fae3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.036604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.038689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 88/164] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/users/e4e528e838ba41aca4d512293626fae3 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:34.039776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.091187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88c27b-dcd2-472f-bcbd-50c6cb7dddaa None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.142451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.143720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.143720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.143720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.144421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:34.144731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.146153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.160159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 77/165] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:34.160792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.180664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c80432f-60ea-410a-8156-9489747bc3f6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.241006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.242602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.243139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.243612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.291133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c621-044d-46eb-a39a-c02e5e6ba928 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.330362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.332187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.342451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.343271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.343557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.343841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.362838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:34.379080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:34.380096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 78/166] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:34.381924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.439294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 89/167] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:34.445496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.550492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d246-84db-4235-8f93-8c207ef51388 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.568521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c87e46-7e4c-4641-8342-d24de85a78f7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.586990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.588316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.588798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.589270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.590735 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.592424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.594326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 90/168] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:34.595480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.618419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.619440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.619722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.619994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.621439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.622927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.629487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 79/169] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:34.629487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.710396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb402f24-8da8-484c-9362-859c62683a46 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.746265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.747324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.747836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.748315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.749289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:34.749833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.751493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c4ad6-edb1-416f-8371-4538053beff4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.751894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39bda6-a866-4452-8704-0dc01720ad05 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.762987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 91/170] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:34.764914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fa83b-b684-4012-ac91-1a06401f2957 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.765428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fa83b-b684-4012-ac91-1a06401f2957 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.765930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fa83b-b684-4012-ac91-1a06401f2957 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.767840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 92/171] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:34.768846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fa83b-b684-4012-ac91-1a06401f2957 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.801284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.802093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.802369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.802637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.804621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.806145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.808067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 80/172] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:34.813315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:34.897865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fa83b-b684-4012-ac91-1a06401f2957 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.923345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a413d-abd1-4cf5-904f-8d41b3d0ff9f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:34.935932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568c825-cc6d-49a7-b92b-8f8b3c50895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.936583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c825-cc6d-49a7-b92b-8f8b3c50895e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.936859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c825-cc6d-49a7-b92b-8f8b3c50895e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.937132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568c825-cc6d-49a7-b92b-8f8b3c50895e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.963658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:34.964585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:34.964814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:34.965081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/e4e528e838ba41aca4d512293626fae3/roles/f12236030bf24b378a9e62e20138a0aa` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:34.967069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb3030e3ef945a6a8787c4f1023bd8a, user_id=e4e528e838ba41aca4d512293626fae3, role_id=f12236030bf24b378a9e62e20138a0aa)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:34.968529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:34.982362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 81/173] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:34 2022] PUT /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/users/e4e528e838ba41aca4d512293626fae3/roles/f12236030bf24b378a9e62e20138a0aa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:34.983466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.030354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568c825-cc6d-49a7-b92b-8f8b3c50895e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:35.032274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568c825-cc6d-49a7-b92b-8f8b3c50895e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:35.101535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6082d42-0675-4c65-b4f7-da8391b4b928 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.135429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 93/174] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:35.136769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60115-4f6c-45fd-b8de-852814890da4 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.137053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60115-4f6c-45fd-b8de-852814890da4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.137325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60115-4f6c-45fd-b8de-852814890da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.141507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.142444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.142724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.143005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] PATH_INFO: `/v3/users/052dcf7b71fa4cc0848daec5968ebb09` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.144253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] RBAC: Authorizing `identity:get_user(user_id=052dcf7b71fa4cc0848daec5968ebb09)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:35.145805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:35.147670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 82/175] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:34 2022] GET /identity/v3/users/052dcf7b71fa4cc0848daec5968ebb09 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:35.153187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.156694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3dd60115-4f6c-45fd-b8de-852814890da4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:35.157925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3dd60115-4f6c-45fd-b8de-852814890da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:35.227852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 94/176] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:35.228998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a270-f068-42ff-9047-c8b6812e96ad None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.229287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a270-f068-42ff-9047-c8b6812e96ad None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.229561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a270-f068-42ff-9047-c8b6812e96ad None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.231002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 95/177] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:35.231933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877a56-e351-49e5-8975-dbb0b62fca52 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.232210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877a56-e351-49e5-8975-dbb0b62fca52 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.232481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877a56-e351-49e5-8975-dbb0b62fca52 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.233681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 96/178] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:35.238758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877a56-e351-49e5-8975-dbb0b62fca52 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.269893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a609b-0ef2-47a7-926a-3b043a55d5ab None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.302173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.302932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.303205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.303481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.304338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=f37f6f0cc485427c90ba2081965287a3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:35.304658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:35.306153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:35.311826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 83/179] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/role_assignments?user.id=f37f6f0cc485427c90ba2081965287a3&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:35.312608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.347738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877a56-e351-49e5-8975-dbb0b62fca52 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.390118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de341-e551-49a0-b4b3-917aa19ba5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.390919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de341-e551-49a0-b4b3-917aa19ba5be None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.391193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de341-e551-49a0-b4b3-917aa19ba5be None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.391472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de341-e551-49a0-b4b3-917aa19ba5be None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.393179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de341-e551-49a0-b4b3-917aa19ba5be None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:35.395061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de341-e551-49a0-b4b3-917aa19ba5be None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:35.397904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 97/180] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:35.397904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0db2-7d88-4101-b455-3d565224cbe3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.397904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0db2-7d88-4101-b455-3d565224cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.397904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a0db2-7d88-4101-b455-3d565224cbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.430072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0b7a0db2-7d88-4101-b455-3d565224cbe3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:35.431444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0b7a0db2-7d88-4101-b455-3d565224cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:35.470177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d04bb7-05e0-471d-b5cf-1fb29e7c0901 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.509215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 98/181] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:35.510219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.510658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.510938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.511209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.511836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.512308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.512872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.531595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:35.532774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:35.603127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:35.604775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:35.610732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 99/182] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:35.611915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.705664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 84/183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:35.706464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.722587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006274-d057-4cb4-99d9-b9c7b7d59fb0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.756452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.758244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.758766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.759236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.769209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:35.777080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:35.778012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:35.778971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:35.780973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 100/184] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:35.781940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.806844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699f2e7-a5ab-4d21-a837-8efe7cc1cb0e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.840311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.840968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.841251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.841537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.842401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] RBAC: Adding query filter params (role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=052dcf7b71fa4cc0848daec5968ebb09) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:35.842719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:35.844161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:35.857768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 85/185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/role_assignments?user.id=052dcf7b71fa4cc0848daec5968ebb09&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:35.857768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.889205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7209f5-074d-4c36-87d3-cb5c18535474 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:35.932738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:35.933764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:35.934127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:35.934470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:35.949753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:35.961330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:35.962257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:35.963652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:35.967118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 101/186] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:35.967118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:35.983912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1d3c-80cd-4754-aade-adf42214d1f4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.019596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.020401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.020681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.020952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.022267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.023818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.025862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 86/187] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.026827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.095080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c16a9-03fd-411f-be0b-d5c6a66f6061 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.138040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.139255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.139536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.139973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] PATH_INFO: `/v3/projects/16d0395301484d17bef5c7a87f5e46c8` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.141825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] RBAC: Authorizing `identity:get_project(project_id=16d0395301484d17bef5c7a87f5e46c8)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.143758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.146023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 102/188] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:35 2022] GET /identity/v3/projects/16d0395301484d17bef5c7a87f5e46c8 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.146565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.146917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc310-3926-4e7f-b833-b19153008456 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.186655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.187325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.187604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.187876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.188623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:36.188934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.190361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.199048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 87/189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.200263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.250478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4531-dd1d-47c4-9e02-aaad87ed9e88 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.283570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.284292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.284624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.285002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.285873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:36.286180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.287946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.296151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 103/190] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.299096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415be4-cde6-4cf4-8f7d-82313ccc67c5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.301284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.332713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.333378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.333656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.333977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.334678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.336147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.361835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 88/191] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:36 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:36.370053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.422396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78f80-53ee-46bc-8ffb-2055378b10f0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.461489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.463074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.463360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.463634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.464543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=16d0395301484d17bef5c7a87f5e46c8, user.id=052dcf7b71fa4cc0848daec5968ebb09) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:36.464858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.466763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.475544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 104/192] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/role_assignments?user.id=052dcf7b71fa4cc0848daec5968ebb09&scope.project.id=16d0395301484d17bef5c7a87f5e46c8&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.476796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.497098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47467793-c9a6-4999-9f00-03bfcdaf11e2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.555462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.556347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.556630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.556901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] PATH_INFO: `/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.591529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] RBAC: Authorizing `identity:get_user(user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.593047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.595032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 89/193] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.601080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.637444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b7b3-b55e-4504-b8f2-288634fd9351 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.680020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.681187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.681296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.681506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] PATH_INFO: `/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.682849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] RBAC: Authorizing `identity:get_user(user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.684405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.686385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 105/194] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:36.693072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:36.738784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ca547-40b2-4fb5-b0c2-334051a4288c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.776844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.777504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.777809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.778081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.819302 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40552734-7fdf-4615-a457-4194ab93b587 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:36.857529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:36.858512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:36.859057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:36.859496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:36.860071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.861631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.930044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:36.931833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:36.965748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 90/195] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:36.973521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:37.053668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 106/196] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:37.062756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:37.088126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12158467-603f-45d5-ad31-3a931c1e7e05 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:37.123938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:37.124812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.125087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.125355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.126678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:37.128189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:37.130155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 91/197] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:36 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:37.136261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:37.238596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767a9d4-b5e1-46a1-96d8-c06d89798efa None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:37.272428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:37.273938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.274273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.274548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.275428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:37.275741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:37.276894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f93275-71dc-49e2-9031-99f21e9ff7ea None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:37.277181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:37.283030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 92/198] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:37 2022] GET /identity/v3/role_assignments?user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:37.352386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31dfc-3a15-47d8-9811-1e0aafc222a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:37.353659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31dfc-3a15-47d8-9811-1e0aafc222a1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.354158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31dfc-3a15-47d8-9811-1e0aafc222a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.354618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31dfc-3a15-47d8-9811-1e0aafc222a1 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.356104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31dfc-3a15-47d8-9811-1e0aafc222a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:37.357903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31dfc-3a15-47d8-9811-1e0aafc222a1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:37.359888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 107/199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:37 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:37.366453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:37.421336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c398d2-e2db-46a0-b2c8-64d905b3c54b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.421981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c398d2-e2db-46a0-b2c8-64d905b3c54b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.422507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c398d2-e2db-46a0-b2c8-64d905b3c54b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.424461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 108/200] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:37.430382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.430918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.431382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.449568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:37.451638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:37.528301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 109/201] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:37.553679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258149ac-6898-4da5-9514-38dc6aef33a2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:37.555789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:37.598300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:37.605184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.605393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.605713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.606589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] RBAC: Adding query filter params (role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:37.606890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:37.611410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:37.622348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 93/202] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:37 2022] GET /identity/v3/role_assignments?user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:37.713876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183654a-7358-43df-bc8e-6a6843a97682 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:37.759990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:37.760794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.761069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.761336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.778684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:37.786382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:37.787248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:37.788042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 110/203] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:37.794123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:37.927916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd80848-3fb0-4b38-ac01-136d62e02c19 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:37.970415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:37.971425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:37.971904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:37.972394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:37.973338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:37.973881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:37.975472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:37.984732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 94/204] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:37.990664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:38.152487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73e700-eb1d-4fa0-b3ca-ed53a2fd2f37 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:38.201220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:38.202048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:38.202327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:38.202599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] PATH_INFO: `/v3/users/e4e528e838ba41aca4d512293626fae3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:38.203828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] RBAC: Authorizing `identity:get_user(user_id=e4e528e838ba41aca4d512293626fae3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:38.205298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:38.207275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 111/205] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:37 2022] GET /identity/v3/users/e4e528e838ba41aca4d512293626fae3 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:38.212915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:38.346391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa167c-5063-48ce-98e9-feb7226bfea7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:38.385771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:38.386430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:38.386711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:38.386988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:38.461039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:38.462494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:38.559985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 95/206] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:38.565135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:38.708245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351d890-f8e7-4980-b9bf-4bfc55eb3d62 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:38.750452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9c33a-4334-43ba-996c-6029a9722eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:38.751652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9c33a-4334-43ba-996c-6029a9722eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:38.752133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9c33a-4334-43ba-996c-6029a9722eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:38.752602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9c33a-4334-43ba-996c-6029a9722eb2 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:38.758518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9c33a-4334-43ba-996c-6029a9722eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:38.760340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9c33a-4334-43ba-996c-6029a9722eb2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:38.762406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 112/207] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:38 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:38.768417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:38.877724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8f92-5fbb-4f61-9ae8-0e9715fa3db2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:38.917233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:38.917985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:38.918264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:38.918537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:38.919375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] RBAC: Adding query filter params (role.id=f12236030bf24b378a9e62e20138a0aa, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a, user.id=e4e528e838ba41aca4d512293626fae3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:38.919689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:38.921147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732880dc-d9b8-48bc-aa9f-fbcb89082a56 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:38.927331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 96/208] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:38 2022] GET /identity/v3/role_assignments?user.id=e4e528e838ba41aca4d512293626fae3&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=f12236030bf24b378a9e62e20138a0aa => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:39.381704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f38e-72af-4b97-bbd8-657b8c7742c8 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.382270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f38e-72af-4b97-bbd8-657b8c7742c8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.382346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f38e-72af-4b97-bbd8-657b8c7742c8 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.383669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 113/209] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:39.388831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.389231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.389412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.409856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:39.409856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:39.465729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacc0f-17fe-4be7-bf1e-17dbcac530d5 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.466063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacc0f-17fe-4be7-bf1e-17dbcac530d5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.466303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacc0f-17fe-4be7-bf1e-17dbcac530d5 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.467890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 114/210] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:39.473192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.473730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.474041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.494679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 97/211] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:39.496164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:39.497603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:39.522469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:39.574504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 115/212] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:39.599104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:39.621457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8ea01-dbc1-45df-a92b-d7781f4c968e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:39.655316 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:39.656028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.656299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.656562 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.667444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:39.675358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:39.676364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:39.677145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:39.680528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 98/213] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:39.686281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:39.702044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9829b8-f946-4ed6-989b-284e7c422f3e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:39.735998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:39.736921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.737201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.737566 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.739101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:39.740635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:39.746925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 116/214] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:39.748259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:39.794080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b86e3f-e8dd-4b9c-8ede-d1cf89ed6c4f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:39.829003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:39.830038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.830504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.830942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.831857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:39.832328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:39.833915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:39.847458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 99/215] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:39.848587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:39.850850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21578eb7-920f-4942-82ba-ab5237dc1c02 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:39.886548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:39.887222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:39.887499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:39.887771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:39.888539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:39.890169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:39.925633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 117/216] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:39 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:42:39.971775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4a1f-08bc-4bbe-b69a-71a816bfaf32 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.008756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083cfd7-ae8d-4af2-85c4-b6eff2fe6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.010079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083cfd7-ae8d-4af2-85c4-b6eff2fe6075 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.010549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083cfd7-ae8d-4af2-85c4-b6eff2fe6075 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.011032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083cfd7-ae8d-4af2-85c4-b6eff2fe6075 None admin] PATH_INFO: `/v3/users/17632f9174f94b7a96039f4d2cbcf19f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.027931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083cfd7-ae8d-4af2-85c4-b6eff2fe6075 None admin] RBAC: Authorizing `identity:get_user(user_id=17632f9174f94b7a96039f4d2cbcf19f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:40.029905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083cfd7-ae8d-4af2-85c4-b6eff2fe6075 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:40.032383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 100/217] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:39 2022] GET /identity/v3/users/17632f9174f94b7a96039f4d2cbcf19f => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:40.038376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.137357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713042f-111e-4033-89f0-069b25e033ea None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.137668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713042f-111e-4033-89f0-069b25e033ea None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.137994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713042f-111e-4033-89f0-069b25e033ea None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.139515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 101/218] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:40.144644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.145172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.145634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.152621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca9568-f8fd-4013-8724-a83a46fcc087 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.167377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:40.168565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:40.199015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad168da-cb7e-409e-a5aa-6c46c5c8978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.199661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad168da-cb7e-409e-a5aa-6c46c5c8978c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.199944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad168da-cb7e-409e-a5aa-6c46c5c8978c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.200219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad168da-cb7e-409e-a5aa-6c46c5c8978c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.253966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 102/219] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:40.277240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.277531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad168da-cb7e-409e-a5aa-6c46c5c8978c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:40.279075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad168da-cb7e-409e-a5aa-6c46c5c8978c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:40.393617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 118/220] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:40.395095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a110-5bac-4af8-98fb-b2e8ab73c61c None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.395413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a110-5bac-4af8-98fb-b2e8ab73c61c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.397432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d44d42-aaff-4598-9998-cf9c4993cd54 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.397871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a110-5bac-4af8-98fb-b2e8ab73c61c None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.397871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 119/221] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:40.402783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.403061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.403333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.432628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.433487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.433804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.434088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.441327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:40.443149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:40.445619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:40.455707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:40.456806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:40.457826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 103/222] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:40.458626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.526123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 120/223] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:40.531368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.585364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663361fd-ad6f-4e2f-a050-81682f466faa None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.619446 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.620383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.620730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.620922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.622507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:40.623721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:40.625416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 104/224] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:40.626231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.662532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496bfe1-d047-4db8-b36b-1f86d40797c4 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.701792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.702645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.703251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.703532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.704569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:40.704876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:40.707080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:40.718720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 121/225] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:40.719653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.749135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96574686-c07d-48c9-8291-f192dc325c5e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.789514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.791209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.791816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.792154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.805314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:40.814842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:40.815737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:40.816522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:40.817122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 105/226] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:40.818301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.837242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f18ff6-b2b3-496b-a731-61e44aca6d52 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.877165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.877836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.878110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.878382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.879191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=17632f9174f94b7a96039f4d2cbcf19f) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:40.879490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:40.880932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:40.894060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 122/227] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/role_assignments?user.id=17632f9174f94b7a96039f4d2cbcf19f&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:40.895079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:40.938521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42f43-76ad-40e0-9dbf-2aa1e0a85e3a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:40.990821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:40.992192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:40.992472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:40.992744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] PATH_INFO: `/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:40.996592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:40.998155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.000169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 106/228] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:41.005674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:41.056228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2862-12fc-4909-9435-88c9a1a95900 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:41.127137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:41.127947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:41.128224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:41.128626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:41.129712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:41.130110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:41.131932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.143792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 123/229] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:41.149579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:41.209278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027ee5e-d773-4005-acae-9948681ac9c5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:41.258269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491c124-d343-40ab-8675-186e195de1e0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:41.290013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:41.291492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:41.292177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:41.292646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:41.296198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:41.296198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:41.296198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:41.296198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] PATH_INFO: `/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:41.297337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] RBAC: Authorizing `identity:get_user(user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:41.297523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:41.299171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.299378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.301244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 107/231] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:41 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:41.306127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 124/231] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:41 2022] GET /identity/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:41.307928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:41.308060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:41.421772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecb810-0dd8-4573-bfac-4fa239de2801 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:41.453892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:41.455072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:41.455619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:41.455996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:41.458229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8d6c330c4124e229a4ac616e449f8c4, user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:41.460271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.497013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 125/232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:41 2022] PUT /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:42:41.508086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b2b2-8b07-4eed-b48e-a9ecfaed2256 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:41.551320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b9b5-88ca-43a0-87ab-0ba27c09ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:41.552431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b9b5-88ca-43a0-87ab-0ba27c09ee63 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:41.552872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b9b5-88ca-43a0-87ab-0ba27c09ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:41.553294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b9b5-88ca-43a0-87ab-0ba27c09ee63 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:41.556324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b9b5-88ca-43a0-87ab-0ba27c09ee63 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:41.558047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b9b5-88ca-43a0-87ab-0ba27c09ee63 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.560035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 108/233] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:41 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:41.566125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:41.699557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79b8e-c431-46a4-9c84-d17b07112051 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:41.741999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8594a7-a39f-4fe5-8dde-6e84e44f71e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:41.742895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8594a7-a39f-4fe5-8dde-6e84e44f71e1 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:41.743236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8594a7-a39f-4fe5-8dde-6e84e44f71e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:41.743502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8594a7-a39f-4fe5-8dde-6e84e44f71e1 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:41.745862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8594a7-a39f-4fe5-8dde-6e84e44f71e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8d6c330c4124e229a4ac616e449f8c4, user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe, role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:41.747319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8594a7-a39f-4fe5-8dde-6e84e44f71e1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:41.779421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 126/234] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:41 2022] PUT /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:42.561217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23d59c-9c16-467f-90dc-7fd5fddb82c1 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:42.562276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23d59c-9c16-467f-90dc-7fd5fddb82c1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:42.562750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23d59c-9c16-467f-90dc-7fd5fddb82c1 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:42.564584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 109/235] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:42.570290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe586a-dca5-497c-800a-98cb42fdd7c8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:42.571235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe586a-dca5-497c-800a-98cb42fdd7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:42.571705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe586a-dca5-497c-800a-98cb42fdd7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:42.589139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3cfe586a-dca5-497c-800a-98cb42fdd7c8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:42.590682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3cfe586a-dca5-497c-800a-98cb42fdd7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:42.690008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 127/236] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:42.727350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23d59c-9c16-467f-90dc-7fd5fddb82c1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:42.821729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9343106-9130-4f48-af6b-6e9114d593bf None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:42.822413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9343106-9130-4f48-af6b-6e9114d593bf None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:42.822896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9343106-9130-4f48-af6b-6e9114d593bf None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:42.824516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 128/237] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:42.830613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:42.831110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:42.831589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:42.853650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23d59c-9c16-467f-90dc-7fd5fddb82c1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:42.867315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:42.868515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:42.907704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:42.908494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:42.908764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:42.909027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:42.932783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:42.942630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:42.943482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:42.944283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 110/238] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:42.954132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:42.988690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 129/239] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:43.025115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.070250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e477e0-24c2-477d-b6ee-cfe2bbce6e45 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:43.108187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:43.108856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.109123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.109386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.110152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:43.110517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:43.111875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:43.120549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 111/240] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:43.125696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.224159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662842-de93-4ed2-8135-cfbff3df636a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:43.257236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:43.258128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.258396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.258659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] PATH_INFO: `/v3/users/831e281535c94bf8ba115f7ef7dc105f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.271880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] RBAC: Authorizing `identity:get_user(user_id=831e281535c94bf8ba115f7ef7dc105f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:43.273940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:43.275625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad405d-91ef-4fec-b7fa-7939d54d0a41 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:43.275968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 112/241] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:43 2022] GET /identity/v3/users/831e281535c94bf8ba115f7ef7dc105f => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:43.281284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.375562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:43.376387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.376663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.376930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.382697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:43.384244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:43.385433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe8b1-1a91-4fe4-a17d-d2739fcf31c4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:43.386404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 130/242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:43.396319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.442831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:43.443483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.445282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.445558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.543951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64597-b948-4b4f-beac-b9a22b82b52f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:43.560560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:43.562064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:43.587841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e5948-f2d0-4460-9514-b2a498424678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:43.588521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e5948-f2d0-4460-9514-b2a498424678 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.588794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e5948-f2d0-4460-9514-b2a498424678 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.589066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e5948-f2d0-4460-9514-b2a498424678 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.589798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e5948-f2d0-4460-9514-b2a498424678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:43.591259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e5948-f2d0-4460-9514-b2a498424678 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:43.633803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 131/243] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:43 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:43.655064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515c38-3872-44dd-9c66-a8e50148bf17 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.655581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515c38-3872-44dd-9c66-a8e50148bf17 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.656002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515c38-3872-44dd-9c66-a8e50148bf17 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.657649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 132/244] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:43.664275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.664793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.665217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.689321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 113/245] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:42:43.690606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:43.692041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:43.695810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.816782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 133/246] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:43.845016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.874072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a960495-357e-4b96-be78-144345f67dd6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:43.911976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:43.912841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:43.913116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:43.913421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:43.914670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:43.916124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:43.917847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 114/247] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:43 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:43.923356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:43.985592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34550c-107f-4df2-9d13-ff87c71126ea None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.021887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.022720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.023001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.023273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.033688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:44.041942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:44.042806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:44.043580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 134/248] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:44.048901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:44.060018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a3b81-5573-4366-a979-374b4ec313f9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.108585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.109262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.109541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.109843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.111021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] RBAC: Adding query filter params (role.id=f12236030bf24b378a9e62e20138a0aa, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=831e281535c94bf8ba115f7ef7dc105f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:44.111334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:44.114413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:44.123660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 115/249] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:43 2022] GET /identity/v3/role_assignments?user.id=831e281535c94bf8ba115f7ef7dc105f&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=f12236030bf24b378a9e62e20138a0aa => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:44.182043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827729cc-1151-4c01-8fac-c3405630e953 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.223387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.224075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.224351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.224615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.225373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:44.226266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:44.227663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:44.239064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 135/250] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:44.245673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:44.387012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d58ea-d480-41a8-bd9a-18a785b2888e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.424875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f429b4e-46e2-4383-bb0f-67f080e7cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.425828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429b4e-46e2-4383-bb0f-67f080e7cb7c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.426106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429b4e-46e2-4383-bb0f-67f080e7cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.426375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f429b4e-46e2-4383-bb0f-67f080e7cb7c None admin] PATH_INFO: `/v3/users/17632f9174f94b7a96039f4d2cbcf19f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.427846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f429b4e-46e2-4383-bb0f-67f080e7cb7c None admin] RBAC: Authorizing `identity:get_user(user_id=17632f9174f94b7a96039f4d2cbcf19f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:44.429922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f429b4e-46e2-4383-bb0f-67f080e7cb7c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:44.431584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 116/251] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:44 2022] GET /identity/v3/users/17632f9174f94b7a96039f4d2cbcf19f => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:44.438026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:44.479417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67b217-207d-4c68-83c2-2fae054ccc8e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.479723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67b217-207d-4c68-83c2-2fae054ccc8e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.480028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67b217-207d-4c68-83c2-2fae054ccc8e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.481727 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 117/252] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:44.487423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.487789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.487973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.517224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:44.518473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:44.588861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab88458-4717-4df5-b969-fda41cbebee4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.624736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.625602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.625906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.626174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.628038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:44.629657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:44.632075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 136/253] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:44 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:44.643412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:44.676980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 118/254] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:44.711392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:44.861581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8ef6-f974-491c-8bbc-bb9b5345fc16 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.864275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387c265-9f85-448a-9fd4-d7fbb0f0b8fe None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:44.899673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299b41-e9b7-4e69-ae56-027b21cb4e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.900711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299b41-e9b7-4e69-ae56-027b21cb4e27 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.901621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299b41-e9b7-4e69-ae56-027b21cb4e27 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.902057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299b41-e9b7-4e69-ae56-027b21cb4e27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.913102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c299b41-e9b7-4e69-ae56-027b21cb4e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-8c299b41-e9b7-4e69-ae56-027b21cb4e27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:44.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:44.922913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:42:44.923957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:44.925961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 119/255] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:44.927612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cda78-b3b2-4164-8429-f0dcd2b6b18a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.928027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cda78-b3b2-4164-8429-f0dcd2b6b18a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.928569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cda78-b3b2-4164-8429-f0dcd2b6b18a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.934580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 120/256] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:44.935563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cda78-b3b2-4164-8429-f0dcd2b6b18a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:44.965768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0db9a-b7a2-4645-99ce-1b5a4260ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:44.967030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0db9a-b7a2-4645-99ce-1b5a4260ac99 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:44.967315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0db9a-b7a2-4645-99ce-1b5a4260ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:44.967639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0db9a-b7a2-4645-99ce-1b5a4260ac99 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/17632f9174f94b7a96039f4d2cbcf19f/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:44.970476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0db9a-b7a2-4645-99ce-1b5a4260ac99 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8d6c330c4124e229a4ac616e449f8c4, user_id=17632f9174f94b7a96039f4d2cbcf19f, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:44.972096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0db9a-b7a2-4645-99ce-1b5a4260ac99 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:45.016012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 137/257] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:44 2022] PUT /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/17632f9174f94b7a96039f4d2cbcf19f/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:45.017621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:45.018103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:45.018527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:45.048991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cda78-b3b2-4164-8429-f0dcd2b6b18a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:45.058816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:45.060034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:45.090116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:45.090801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:45.091073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:45.091343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:45.092614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:45.092981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:45.094954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:45.105417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 121/258] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:45.111243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:45.223688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 138/259] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:45.291110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b8000-46f2-45a1-99d9-28249f7dca10 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:45.332230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:45.333723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:45.334676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:45.334953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:45.335287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] PATH_INFO: `/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:45.337769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] RBAC: Authorizing `identity:get_user(user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:45.338991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:45.345206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 122/260] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:45 2022] GET /identity/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:45.348734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:45.491503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c662da-39cc-4028-b1f0-21d0368bab3d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:45.528169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:45.528832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:45.529109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:45.529538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:45.579910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf646826-a912-484f-b531-58c1060bbe13 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:45.604049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:45.605523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:45.661338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:45.662182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:45.662504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:45.662778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:45.694287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:45.708986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 123/261] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:45.711649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:45.712512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:45.713468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 139/262] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:45.715349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:45.718395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:45.837595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551aafe-191c-4d76-9dd9-f77b6d5f3eff None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:45.874160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:45.875009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:45.875282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:45.875536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:45.877217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:45.879499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:45.883041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 124/263] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:45 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:45.889532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:45.943518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60df5c-f449-4256-9f6c-7b5975a24b50 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:46.004307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:46.004990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:46.005267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:46.005535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:46.006320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:46.006618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:46.008681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:46.018244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 140/264] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:46.024860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:46.083898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177fccf-34c5-46a7-9e52-85dddb71fef0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:46.140856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd147f-c5cb-4202-8ae1-45203a299717 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:46.179746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:46.180900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:46.181360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:46.181818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] PATH_INFO: `/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:46.182453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:46.183106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:46.183385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:46.183634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] RBAC: Authorizing `identity:get_user(user_id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:46.183750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:46.184475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:46.184781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:46.185615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:46.186246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:46.187915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 141/265] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:46 2022] GET /identity/v3/users/b3cc9d7ca4e14fdda99e7f16a0c0dbfe => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:46.193106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:46.197184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 125/266] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:45 2022] GET /identity/v3/role_assignments?user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:46.307501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d976e3-ec00-44f2-8a63-2e130a3d72c9 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:46.342683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:46.343624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:46.344038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:46.344444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:46.415294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:46.417000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:46.529306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 142/267] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:46.535433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:46.657768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3a182-3322-4645-9cc0-1d0e80b186ce None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:46.689113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d06e40-ca37-4f9c-bc92-7f257e731030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:46.690310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06e40-ca37-4f9c-bc92-7f257e731030 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:46.690757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06e40-ca37-4f9c-bc92-7f257e731030 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:46.691192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d06e40-ca37-4f9c-bc92-7f257e731030 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:46.692536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06e40-ca37-4f9c-bc92-7f257e731030 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:46.694229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d06e40-ca37-4f9c-bc92-7f257e731030 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:46.696491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 126/268] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:46 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:46.702086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:46.815719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290f2c-2a23-4ef3-9630-ed4766a4bc15 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:46.859283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:46.860278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:46.860725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:46.861221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:46.862662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] RBAC: Adding query filter params (role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:46.863587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:46.865258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e2118-ee78-4fa1-8b39-7c7fe63d962a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:46.879967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 143/269] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:46 2022] GET /identity/v3/role_assignments?user.id=b3cc9d7ca4e14fdda99e7f16a0c0dbfe&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:47.069153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefb1d9-2c99-4013-9de3-c81d50b52661 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.069153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefb1d9-2c99-4013-9de3-c81d50b52661 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.069153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefb1d9-2c99-4013-9de3-c81d50b52661 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.069153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 127/270] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:47.080345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.080884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.081299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.112829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:47.118426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:47.219420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 144/271] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:47.254532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefb1d9-2c99-4013-9de3-c81d50b52661 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:47.376129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefb1d9-2c99-4013-9de3-c81d50b52661 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:47.423787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029e05b-6748-4d44-9789-c8b6367df27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:47.424802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029e05b-6748-4d44-9789-c8b6367df27e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.425222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029e05b-6748-4d44-9789-c8b6367df27e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.425628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029e05b-6748-4d44-9789-c8b6367df27e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.436338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029e05b-6748-4d44-9789-c8b6367df27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-5029e05b-6748-4d44-9789-c8b6367df27e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:47.444911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:47.445997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:47.446944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:47.449238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 128/272] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:47.454813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:47.470457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0612-4b9a-4e04-971b-63874fa5b5df None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.470736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0612-4b9a-4e04-971b-63874fa5b5df None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.471013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0612-4b9a-4e04-971b-63874fa5b5df None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.472516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 129/273] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:42:47.477634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.477979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.478255 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.496688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:47.498508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:47.593839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 130/274] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:47.600205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde84a2-0013-4c33-a97d-d75d8643b154 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:47.612682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:47.641480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:47.643035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.644193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.645812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:47.646334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:47.648623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:47.663271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 145/275] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:47.664829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:47.730965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a420-be8a-45a9-adf2-d4481fa4a862 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:47.764992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9779d71-996a-48f4-aa59-aa9b28717cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:47.765816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9779d71-996a-48f4-aa59-aa9b28717cdb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.765917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dca5ad-b8a1-4083-91b3-228406a2af31 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:47.766329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9779d71-996a-48f4-aa59-aa9b28717cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.766400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9779d71-996a-48f4-aa59-aa9b28717cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.776770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9779d71-996a-48f4-aa59-aa9b28717cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a9779d71-996a-48f4-aa59-aa9b28717cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:47.784145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:47.785220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:47.786059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 131/276] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:47.786906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e296f6-8549-4b2e-a4df-f13cd51301a3 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.787187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e296f6-8549-4b2e-a4df-f13cd51301a3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.787462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e296f6-8549-4b2e-a4df-f13cd51301a3 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.788852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 132/277] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:47.794917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e296f6-8549-4b2e-a4df-f13cd51301a3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:47.807552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce9588-75f4-4b7a-854a-697be6247d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:47.808413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce9588-75f4-4b7a-854a-697be6247d16 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.808687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce9588-75f4-4b7a-854a-697be6247d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.808954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce9588-75f4-4b7a-854a-697be6247d16 None admin] PATH_INFO: `/v3/users/831e281535c94bf8ba115f7ef7dc105f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.810166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce9588-75f4-4b7a-854a-697be6247d16 None admin] RBAC: Authorizing `identity:get_user(user_id=831e281535c94bf8ba115f7ef7dc105f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:47.811612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce9588-75f4-4b7a-854a-697be6247d16 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:47.813572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 146/278] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/users/831e281535c94bf8ba115f7ef7dc105f => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:47.814803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.815084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.815352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.831782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:47.832931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:47.898621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 147/279] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:47.901006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:47.911374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e296f6-8549-4b2e-a4df-f13cd51301a3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:47.945485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:47.946194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:47.946472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:47.946743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:47.947486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:47.947784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:47.949181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:47.957168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 133/280] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:47.957993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.016710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f27075-e425-490b-84d6-39ae82d4c373 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.051604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.052353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452838d6-33dc-4198-81cb-bd2bbf6c0075 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.052465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.052719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.052986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.054200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.055638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.057314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 148/281] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:48.058168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.090089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.090892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.091145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.091410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.092555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.094030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.095626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 134/282] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:48.096355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.161311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a990-9904-4d8a-bb28-d6d6570aac07 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.196902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff1877-5125-4682-9601-630c79eab746 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.198073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.199192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.199615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.200029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] PATH_INFO: `/v3/users/5651f31ca9974ba1a3f10d1afab1446d` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.213573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] RBAC: Authorizing `identity:get_user(user_id=5651f31ca9974ba1a3f10d1afab1446d)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.215256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.217407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 149/283] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:48 2022] GET /identity/v3/users/5651f31ca9974ba1a3f10d1afab1446d => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:48.218327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.230008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.230953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.231230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.231500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/831e281535c94bf8ba115f7ef7dc105f/roles/f12236030bf24b378a9e62e20138a0aa` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.233432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8d6c330c4124e229a4ac616e449f8c4, user_id=831e281535c94bf8ba115f7ef7dc105f, role_id=f12236030bf24b378a9e62e20138a0aa)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.235026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.257885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 135/284] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:42:48 2022] PUT /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/users/831e281535c94bf8ba115f7ef7dc105f/roles/f12236030bf24b378a9e62e20138a0aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:48.259162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.329051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884ac2b-b362-4782-93ca-94e094c6b52c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.364717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a3305-042a-49da-94e1-8abcf050ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.365391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3305-042a-49da-94e1-8abcf050ed77 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.365670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3305-042a-49da-94e1-8abcf050ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.366021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a3305-042a-49da-94e1-8abcf050ed77 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.367286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a3305-042a-49da-94e1-8abcf050ed77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.368762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a3305-042a-49da-94e1-8abcf050ed77 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.388528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4e27-73c8-42f1-8c86-eaf05990d237 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.391665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 150/285] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:42:48 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:48.393032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948895f-5f60-40b4-af55-2c3c1de80808 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.393320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948895f-5f60-40b4-af55-2c3c1de80808 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.394040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948895f-5f60-40b4-af55-2c3c1de80808 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.395618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 151/286] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:48.403867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.404307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.405022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.423225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:48.424709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:48.438384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.439689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.440120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.440683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.441816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, user.id=5651f31ca9974ba1a3f10d1afab1446d, scope.system=all) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:48.442276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.445183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.458431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 136/287] 10.222.0.70 () {56 vars in 1308 bytes} [Mon May 16 16:42:48 2022] GET /identity/v3/role_assignments?user.id=5651f31ca9974ba1a3f10d1afab1446d&scope.system=all&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:48.519201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 152/288] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:48.543768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.654592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db9f9e-d50f-407e-92f0-f2078b6c5788 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.690869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.691590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.691874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.692148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.702686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:48.710427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:48.711287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:48.712072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 137/289] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:48.718713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.830741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35912dcd-8aab-4f6e-8cf1-813854ae7fe8 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:48.866174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:48.867367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:48.867645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:48.867914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:48.868662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:48.868965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:48.870382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:48.879323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 153/290] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:48.884619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:48.984802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e17180-8a3e-46f9-8b18-e7cbfcc45b0e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:49.019695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:49.020572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:49.020852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:49.021124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] PATH_INFO: `/v3/users/17632f9174f94b7a96039f4d2cbcf19f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:49.022393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] RBAC: Authorizing `identity:get_user(user_id=17632f9174f94b7a96039f4d2cbcf19f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:49.023890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:49.025842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 138/291] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:48 2022] GET /identity/v3/users/17632f9174f94b7a96039f4d2cbcf19f => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:49.031038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:49.161669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e171a-23f6-4cce-8780-1e4e6f0a61ab None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:49.203801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:49.204454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:49.204735 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:49.205009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:49.297237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:49.298660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:49.430177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 154/292] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:49.435881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:49.598556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb937-f249-4005-8f19-6cdb1ef72e4f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:49.630602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7743cd-8765-46ed-946a-25895b899a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:49.631461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7743cd-8765-46ed-946a-25895b899a22 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:49.632256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7743cd-8765-46ed-946a-25895b899a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:49.632541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7743cd-8765-46ed-946a-25895b899a22 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:49.633768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7743cd-8765-46ed-946a-25895b899a22 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:49.635239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7743cd-8765-46ed-946a-25895b899a22 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:49.637236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 139/293] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:49 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:49.643482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:49.767465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75453c7-47b2-41d7-a61b-75ca6c9b9213 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:49.801881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:49.802910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:49.803395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:49.804389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:49.805401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=17632f9174f94b7a96039f4d2cbcf19f) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:49.806000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:49.807652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544cc45-cefd-4e52-af75-d188ac666afb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:49.813829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 155/294] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:49 2022] GET /identity/v3/role_assignments?user.id=17632f9174f94b7a96039f4d2cbcf19f&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:50.754911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69dac-d2ff-410b-807a-9ca03457f640 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:50.755409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69dac-d2ff-410b-807a-9ca03457f640 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:50.755409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae69dac-d2ff-410b-807a-9ca03457f640 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:50.757038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 140/295] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:50.762336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c4b3-6c40-4d94-a56e-0511cf08003f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:50.762746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c4b3-6c40-4d94-a56e-0511cf08003f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:50.762910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c4b3-6c40-4d94-a56e-0511cf08003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:50.779973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4155c4b3-6c40-4d94-a56e-0511cf08003f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:50.781137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4155c4b3-6c40-4d94-a56e-0511cf08003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:50.851732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 156/296] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:50.875038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69dac-d2ff-410b-807a-9ca03457f640 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:50.977624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae69dac-d2ff-410b-807a-9ca03457f640 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.014078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.014809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.015088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.015358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.023975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ef39-343b-4f97-a7d1-8d07b0c38a6e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.024260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ef39-343b-4f97-a7d1-8d07b0c38a6e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.024535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ef39-343b-4f97-a7d1-8d07b0c38a6e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.026437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 157/297] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:51.031793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:51.032085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.032465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.032845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:51.040682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:51.041790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:51.042776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:51.045168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 141/298] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:51.051555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.056963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:51.058422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:51.138518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 158/299] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:51.158259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781e4ea-af5b-4443-8bbc-4d47ea3913b6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.160929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.193996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.195401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.195680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.195953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.196719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:51.197025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.198482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cce443-2555-480c-a897-ee2cb09c1a0c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.207598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 142/300] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:51.211598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ede94-3daa-4f76-b68e-6ce8c4cab9f9 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.212063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ede94-3daa-4f76-b68e-6ce8c4cab9f9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.212645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ede94-3daa-4f76-b68e-6ce8c4cab9f9 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.214818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 143/301] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:51.219184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ede94-3daa-4f76-b68e-6ce8c4cab9f9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.269109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1516e-62ed-479c-8ebe-bf3bb2a406e2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.302408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d710152-35f8-4e90-98ed-100017a5f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.303230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710152-35f8-4e90-98ed-100017a5f02a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.303477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710152-35f8-4e90-98ed-100017a5f02a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.304273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d710152-35f8-4e90-98ed-100017a5f02a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.314252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d710152-35f8-4e90-98ed-100017a5f02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:51.319277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ede94-3daa-4f76-b68e-6ce8c4cab9f9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-5d710152-35f8-4e90-98ed-100017a5f02a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:51.322410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:51.323410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:51.324370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 159/302] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:42:51.325128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.325204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.325431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.342718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:51.343878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:51.355633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.356503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.356808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.357079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] PATH_INFO: `/v3/users/831e281535c94bf8ba115f7ef7dc105f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.358285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] RBAC: Authorizing `identity:get_user(user_id=831e281535c94bf8ba115f7ef7dc105f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.359734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.361362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 144/303] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/users/831e281535c94bf8ba115f7ef7dc105f => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:51.362144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.413262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 160/304] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:51.414150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.464850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07aa98f-929b-4ed8-b8b1-7ada8630ed66 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.496631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.497288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.497562 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.497858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.498592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:51.498891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.500262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e13fb-3f53-43af-a511-d486dd5664e7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.508338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 145/305] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:51.509685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879a161-e3b9-4361-ac04-384a34903760 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.509997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879a161-e3b9-4361-ac04-384a34903760 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.510273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879a161-e3b9-4361-ac04-384a34903760 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.511048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5ad06-e582-4b70-b5c8-2e3e7ac77c8a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.511618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 146/306] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:51.512242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879a161-e3b9-4361-ac04-384a34903760 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.544372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.544942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.545210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.545476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.607160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.608633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.609505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879a161-e3b9-4361-ac04-384a34903760 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.640505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c163-fc79-46e7-b88a-7fe2aaf5be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.641280 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c163-fc79-46e7-b88a-7fe2aaf5be07 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.641558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c163-fc79-46e7-b88a-7fe2aaf5be07 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.641857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c163-fc79-46e7-b88a-7fe2aaf5be07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.651942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3c163-fc79-46e7-b88a-7fe2aaf5be07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-56d3c163-fc79-46e7-b88a-7fe2aaf5be07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:51.659512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:51.660352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:51.661167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 147/307] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:51.662370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.662370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.662370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.678142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:51.679340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:51.704954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 161/308] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:51.704954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.741318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 148/309] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:51.743379 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.793483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcd629-ab93-4408-aace-304232237ef9 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.825533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.826419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.826695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.826968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] PATH_INFO: `/v3/users/5651f31ca9974ba1a3f10d1afab1446d` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.828168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] RBAC: Authorizing `identity:get_user(user_id=5651f31ca9974ba1a3f10d1afab1446d)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.829614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.831254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 162/310] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/users/5651f31ca9974ba1a3f10d1afab1446d => generated 293 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:51.832007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.834181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822048c-68e5-41c6-9891-06a4dad432d4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.866332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.866987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.867262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.867530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.868266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:51.868566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.869959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.877494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 149/311] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:51.878330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.923971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d311-7a4c-45e0-9db9-ef5d1c0d9da5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:51.955390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:51.956234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:51.956509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:51.956780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:51.957990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:51.959429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:51.961731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 163/312] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:51.961731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:51.970301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8e123-38fb-4297-952e-5a39e7f0f8cc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:52.001382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:52.002187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:52.002459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:52.002724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:52.003864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:52.005298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:52.007456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 150/313] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:52.012137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:52.054662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9e14d-fd20-4ca5-b9eb-2858651b25a2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:52.086179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:52.087032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:52.087307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:52.087578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] PATH_INFO: `/v3/system/users/5651f31ca9974ba1a3f10d1afab1446d/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:52.089036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5651f31ca9974ba1a3f10d1afab1446d, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:52.090471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:52.099395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 164/314] 10.222.0.70 () {58 vars in 1334 bytes} [Mon May 16 16:42:51 2022] PUT /identity/v3/system/users/5651f31ca9974ba1a3f10d1afab1446d/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:52.100339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:52.101283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6633-0c99-4d13-b7d6-90b832cd0d04 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:52.137752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:52.138652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:52.138928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:52.139203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] PATH_INFO: `/v3/users/6d30e7a83c274229b420e170ab6b77ad` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:52.153291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] RBAC: Authorizing `identity:get_user(user_id=6d30e7a83c274229b420e170ab6b77ad)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:52.154831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:52.161683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 151/315] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:52 2022] GET /identity/v3/users/6d30e7a83c274229b420e170ab6b77ad => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:52.161683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:52.207956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414c04d-a9f0-4bd4-a3ec-585349695d54 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:52.242821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:52.243482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:52.243761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:52.244040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:52.244891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] RBAC: Adding query filter params (role.id=f12236030bf24b378a9e62e20138a0aa, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4, user.id=831e281535c94bf8ba115f7ef7dc105f) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:52.245202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:52.246705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:52.253130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 165/316] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:42:52 2022] GET /identity/v3/role_assignments?user.id=831e281535c94bf8ba115f7ef7dc105f&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=f12236030bf24b378a9e62e20138a0aa => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:52.254011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:52.272054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd887a-3dfc-4d49-8676-9c29744e7417 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:52.313688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f9f25-c4e2-468f-ae67-480d6ac4c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:52.314429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f9f25-c4e2-468f-ae67-480d6ac4c927 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:52.314711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f9f25-c4e2-468f-ae67-480d6ac4c927 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:52.314982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f9f25-c4e2-468f-ae67-480d6ac4c927 None admin] PATH_INFO: `/v3/groups` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:52.315692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f9f25-c4e2-468f-ae67-480d6ac4c927 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:52.317245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f9f25-c4e2-468f-ae67-480d6ac4c927 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:52.335644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 152/317] 10.222.0.70 () {60 vars in 1134 bytes} [Mon May 16 16:42:52 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:52.367799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ac453-3e44-4568-8578-17e22bb9d591 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:52.416068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:52.417022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:52.417450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:52.417900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:52.418909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] RBAC: Adding query filter params (role.id=f12236030bf24b378a9e62e20138a0aa, user.id=6d30e7a83c274229b420e170ab6b77ad, scope.system=all) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:52.419377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:52.421090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c506ba-7226-44bc-abc3-c90e1f85fa77 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:52.427578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 166/318] 10.222.0.70 () {56 vars in 1308 bytes} [Mon May 16 16:42:52 2022] GET /identity/v3/role_assignments?user.id=6d30e7a83c274229b420e170ab6b77ad&scope.system=all&role.id=f12236030bf24b378a9e62e20138a0aa => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:54.383685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19694c5-f93b-4051-b98a-469341285303 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.384216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19694c5-f93b-4051-b98a-469341285303 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.384216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19694c5-f93b-4051-b98a-469341285303 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.385873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 153/319] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:54.391069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c250b11-83d5-45d0-8008-c3980cefc389 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.391492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c250b11-83d5-45d0-8008-c3980cefc389 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.391654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c250b11-83d5-45d0-8008-c3980cefc389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.411007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1c250b11-83d5-45d0-8008-c3980cefc389 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:54.412791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1c250b11-83d5-45d0-8008-c3980cefc389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:54.485802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 167/320] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:54.509654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19694c5-f93b-4051-b98a-469341285303 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:54.604404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19694c5-f93b-4051-b98a-469341285303 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:54.617622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfedac-ae1b-4a23-aa47-5e79be562efa None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.617932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfedac-ae1b-4a23-aa47-5e79be562efa None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.618203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfedac-ae1b-4a23-aa47-5e79be562efa None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.619699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 168/321] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:54.624430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6e757-ce75-4599-afb6-ebfe123bc4ce None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.624708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6e757-ce75-4599-afb6-ebfe123bc4ce None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.624975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6e757-ce75-4599-afb6-ebfe123bc4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.639951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa46bc7-4d33-4690-a0b5-e9cf09ba8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:54.640665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa46bc7-4d33-4690-a0b5-e9cf09ba8bcf None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.640936 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa46bc7-4d33-4690-a0b5-e9cf09ba8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.641198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa46bc7-4d33-4690-a0b5-e9cf09ba8bcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.642604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-76f6e757-ce75-4599-afb6-ebfe123bc4ce None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:54.643768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-76f6e757-ce75-4599-afb6-ebfe123bc4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:54.650941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa46bc7-4d33-4690-a0b5-e9cf09ba8bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-6fa46bc7-4d33-4690-a0b5-e9cf09ba8bcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:54.658484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:54.659331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:42:54.660144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 154/322] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:54.661272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ea2d3-0913-47c8-9ad2-46092924ab99 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.661272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ea2d3-0913-47c8-9ad2-46092924ab99 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.661418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ea2d3-0913-47c8-9ad2-46092924ab99 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.662713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 155/323] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:54.665135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ea2d3-0913-47c8-9ad2-46092924ab99 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:54.712853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 169/324] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:54.714326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.714622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.714886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.730540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:54.731692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:54.766109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ea2d3-0913-47c8-9ad2-46092924ab99 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:54.793836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 170/325] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:54.794664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:54.798451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:54.799112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.799389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.799656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.800396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:54.800697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:54.802113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:54.810485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 156/326] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:54.815912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:54.886297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21467-0306-4bbd-bac3-278710dd1e23 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:54.906029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb768-d58a-4335-af06-643b55a8360a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:54.917188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:54.917988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.918260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.918526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.919652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:54.921084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:54.922873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 171/327] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:54.923438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:54.940006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:54.940861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:54.941139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:54.941408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] PATH_INFO: `/v3/users/5651f31ca9974ba1a3f10d1afab1446d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:54.942618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] RBAC: Authorizing `identity:get_user(user_id=5651f31ca9974ba1a3f10d1afab1446d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:54.944048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:54.946362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 157/328] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:54 2022] GET /identity/v3/users/5651f31ca9974ba1a3f10d1afab1446d => generated 293 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:54.946979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:55.015671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ae4e4-727d-4ff4-8a22-3d179cc0428f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:55.037655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71536e6e-ed86-49fd-afe4-0ea74db01b0b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:55.046936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:55.047709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:55.047981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:55.048247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:55.058469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:55.066090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:55.067058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:55.067844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 172/329] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:55.068485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:55.074066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:55.074730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:55.074998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:55.075265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] PATH_INFO: `/v3/groups` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:55.075946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:55.077365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:55.091017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 158/330] 10.222.0.70 () {60 vars in 1134 bytes} [Mon May 16 16:42:54 2022] POST /identity/v3/groups => generated 226 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:42:55.091818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:55.177110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70050-d332-4380-b4a8-7aeda420d068 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:55.203612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6102ac-875e-49f7-af5c-c173259fc592 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:55.211964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:55.212639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:55.212918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:55.213192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:55.214069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] RBAC: Adding query filter params (role.id=e88b00d27c2f432c9dd8cefff2ee1371, user.id=5651f31ca9974ba1a3f10d1afab1446d, scope.system=all) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:55.214384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:55.215905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:55.235524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 173/331] 10.222.0.70 () {56 vars in 1308 bytes} [Mon May 16 16:42:55 2022] GET /identity/v3/role_assignments?user.id=5651f31ca9974ba1a3f10d1afab1446d&scope.system=all&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:55.244591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:55.245299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:55.245578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:55.245875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:55.246664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:55.247031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:55.248509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:55.258876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 159/332] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:55.264779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:55.375099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb393a3-0df6-4fb0-8be9-3c37b812ae0c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:55.415634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90304300-1fc0-4657-82c6-595e071ef35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:55.417876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304300-1fc0-4657-82c6-595e071ef35b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:55.417876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304300-1fc0-4657-82c6-595e071ef35b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:55.417876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90304300-1fc0-4657-82c6-595e071ef35b None admin] PATH_INFO: `/v3/users/6d30e7a83c274229b420e170ab6b77ad` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:55.418796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90304300-1fc0-4657-82c6-595e071ef35b None admin] RBAC: Authorizing `identity:get_user(user_id=6d30e7a83c274229b420e170ab6b77ad)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:55.421128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90304300-1fc0-4657-82c6-595e071ef35b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:55.422206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 174/333] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:42:55 2022] GET /identity/v3/users/6d30e7a83c274229b420e170ab6b77ad => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:55.427779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:55.532422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09c71f-f14a-452e-a2fa-4e2327630062 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:55.567120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda977f-f1e4-47a0-9027-3f2cd4f1688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:55.568339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda977f-f1e4-47a0-9027-3f2cd4f1688b None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:55.568850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda977f-f1e4-47a0-9027-3f2cd4f1688b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:55.569346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda977f-f1e4-47a0-9027-3f2cd4f1688b None admin] PATH_INFO: `/v3/system/users/6d30e7a83c274229b420e170ab6b77ad/roles/f12236030bf24b378a9e62e20138a0aa` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:55.570906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda977f-f1e4-47a0-9027-3f2cd4f1688b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d30e7a83c274229b420e170ab6b77ad, role_id=f12236030bf24b378a9e62e20138a0aa)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:55.572291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda977f-f1e4-47a0-9027-3f2cd4f1688b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:55.583192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 160/334] 10.222.0.70 () {58 vars in 1334 bytes} [Mon May 16 16:42:55 2022] PUT /identity/v3/system/users/6d30e7a83c274229b420e170ab6b77ad/roles/f12236030bf24b378a9e62e20138a0aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:42:57.730134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f27ca-1911-4715-9f9c-b5d156c038de None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:57.731136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f27ca-1911-4715-9f9c-b5d156c038de None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:57.731610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f27ca-1911-4715-9f9c-b5d156c038de None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:57.733448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 175/335] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:57.741918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:57.742414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:57.742486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:57.766787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:57.768001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:57.851811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 161/336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:57.887413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f27ca-1911-4715-9f9c-b5d156c038de None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.007580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f27ca-1911-4715-9f9c-b5d156c038de None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:58.042809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:58.043610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.043890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.044161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.054947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:58.065120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:58.066051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:58.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 176/337] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:58.072687 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.190060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc6438-8e45-4de5-84bb-29b62c341b3b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:58.229704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:58.230772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.231264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.231734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.232692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:58.233195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:58.234863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9561-68f2-40e7-846b-8e672c462a1e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:58.244628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 162/338] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:58.250262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.385507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6b56a-73a4-46ee-a701-cb61cea865f3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:58.433943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:58.434593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.434873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.435144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.435502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651054-cdf9-45d7-9702-7ccb745f4c4d None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.435979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651054-cdf9-45d7-9702-7ccb745f4c4d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.436555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651054-cdf9-45d7-9702-7ccb745f4c4d None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.442191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 163/339] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:58.450706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323f19b-cd54-401c-8de6-558d627d244d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.451258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323f19b-cd54-401c-8de6-558d627d244d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.451729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323f19b-cd54-401c-8de6-558d627d244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.482844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5323f19b-cd54-401c-8de6-558d627d244d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:58.484391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5323f19b-cd54-401c-8de6-558d627d244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:58.512008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:58.513840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:58.584321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 164/340] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:58.593791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2737-ad84-475c-9a42-1687b592fa52 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.594378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2737-ad84-475c-9a42-1687b592fa52 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.594869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2737-ad84-475c-9a42-1687b592fa52 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.596830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 165/341] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:58.602896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.603476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.603991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.615825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 177/342] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:58.622103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.642838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:58.644303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:58.730373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5075178-f501-4dac-9af3-8875e17925fd None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:58.766103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:58.767207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.767628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.768069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.769400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:58.771021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:58.772996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 178/343] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:58 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:42:58.774018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.806828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 166/344] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:42:58.807712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.875893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd458-9652-4348-b781-58bf4f6b0a87 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:58.910800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:58.911919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:58.912416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:58.912939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:58.923962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:58.932098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:58.932991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:42:58.933789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:58.936261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 179/345] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:58.937257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:58.991968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b18a5-aec9-4762-b617-6701732158e2 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.037141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a69e-8674-492c-9e51-3ec1d675e291 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.061121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.062311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.062736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.063191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.071973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:59.072571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba8cc2-94aa-40d3-9ca6-16b4bf0bcbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.073452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8cc2-94aa-40d3-9ca6-16b4bf0bcbca None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.073821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8cc2-94aa-40d3-9ca6-16b4bf0bcbca None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.074165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba8cc2-94aa-40d3-9ca6-16b4bf0bcbca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.074591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:59.076485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 167/346] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:42:58 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:59.082292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.085617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba8cc2-94aa-40d3-9ca6-16b4bf0bcbca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0aba8cc2-94aa-40d3-9ca6-16b4bf0bcbca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:59.093699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:59.094622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:59.095419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 180/347] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:42:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:59.096726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e9638-0838-4ef8-9928-5ed9bd03fd4c None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.097074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e9638-0838-4ef8-9928-5ed9bd03fd4c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.097413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e9638-0838-4ef8-9928-5ed9bd03fd4c None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.099015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 181/348] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:59.099922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e9638-0838-4ef8-9928-5ed9bd03fd4c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.225273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ce9c1-d40c-4754-a2d7-ba3295beaef2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.227849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e9638-0838-4ef8-9928-5ed9bd03fd4c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.264761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.265674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.266113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.266523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.266631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.267314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.267618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:59.267926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:59.268116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.268535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.269371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:59.269644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:59.270111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:59.271817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d33e3f-6d40-4f9b-86ad-6c7d888e765f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:59.277420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 182/349] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:59.277420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.289504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 168/350] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:59.293611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.294160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.294614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.320632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:59.322087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:59.426073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 169/351] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:59.426982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.449651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cd066-bedf-4f08-9c2b-71b0ae752855 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.492035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.492953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.493381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.493947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.494878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:59.495443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:59.499167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80526-70e9-4fd4-a2fa-86b38b90ee54 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:59.517122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 183/352] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:59.518524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ef4fe-9ed7-41f4-8532-1b66ebba75b6 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.518808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ef4fe-9ed7-41f4-8532-1b66ebba75b6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.519079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ef4fe-9ed7-41f4-8532-1b66ebba75b6 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.520305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 184/353] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:42:59.523872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ef4fe-9ed7-41f4-8532-1b66ebba75b6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.571738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8a2cf-ce68-437f-89aa-67ca4bed86ec None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.608041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.608965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.609438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.609953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.633983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ef4fe-9ed7-41f4-8532-1b66ebba75b6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.670187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ffc0d-7d18-42e2-a55e-d40c8e350df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.671213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ffc0d-7d18-42e2-a55e-d40c8e350df1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.671650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ffc0d-7d18-42e2-a55e-d40c8e350df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.672064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ffc0d-7d18-42e2-a55e-d40c8e350df1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.683129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:59.683323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ffc0d-7d18-42e2-a55e-d40c8e350df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:42:59.685092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-a88ffc0d-7d18-42e2-a55e-d40c8e350df1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:42:59.691079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:42:59.692108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 16 16:42:59.692916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:42:59.695523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 185/354] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:42:59.696957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.697452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.698046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.714819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:42:59.716300 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:42:59.785796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 186/355] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:42:59.787035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 170/356] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:42:59.787848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.787963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.898277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef311-cca9-4a81-9dd5-a350972a12c9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.898491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e875-bd42-46ff-bb5f-5c2be780961f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:42:59.935666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.936341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.936619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.936888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:42:59.937818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:42:59.937969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:42:59.939362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:42:59.948513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:42:59.948715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 171/357] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:42:59.949592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:42:59.950274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:42:59.950760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:42:59.951232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.038374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.039791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.062783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2980092-69e6-43f4-b6c9-1d17078d5989 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.096623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.097489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.097794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.098074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.099819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.102193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.105475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 172/358] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.106279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.167586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 187/359] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:00.168461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.235802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8515b03-924d-4f05-9f65-f7c5d4f8cf66 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.277381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a07f5-794b-426c-8665-a1b7aa4d3529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.278229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a07f5-794b-426c-8665-a1b7aa4d3529 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.278503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a07f5-794b-426c-8665-a1b7aa4d3529 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.278772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a07f5-794b-426c-8665-a1b7aa4d3529 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.288806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942f51d-e56d-4863-bc08-d9f2285fa007 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.293719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a07f5-794b-426c-8665-a1b7aa4d3529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-725a07f5-794b-426c-8665-a1b7aa4d3529 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:00.301889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:00.302995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:00.304553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 173/360] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:00.305773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda980-61f9-45ea-98df-c9bb66261acd None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.310139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda980-61f9-45ea-98df-c9bb66261acd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.310419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda980-61f9-45ea-98df-c9bb66261acd None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.311925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 174/361] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:00.313825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda980-61f9-45ea-98df-c9bb66261acd None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.340579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.341436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.341698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.342008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] PATH_INFO: `/v3/users/6d30e7a83c274229b420e170ab6b77ad` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.343338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] RBAC: Authorizing `identity:get_user(user_id=6d30e7a83c274229b420e170ab6b77ad)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.344894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.347410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 188/362] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/users/6d30e7a83c274229b420e170ab6b77ad => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.348167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.440993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda980-61f9-45ea-98df-c9bb66261acd None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.458662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107404-83ea-4153-9502-58a610115c12 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.481929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.482793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.483072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.483346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.484533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.486027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.487660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 175/363] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.488683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.500473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38a13-43b1-43f5-901f-215e796757ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.501445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38a13-43b1-43f5-901f-215e796757ce None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.501718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38a13-43b1-43f5-901f-215e796757ce None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.502068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38a13-43b1-43f5-901f-215e796757ce None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.503338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d38a13-43b1-43f5-901f-215e796757ce None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.504797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d38a13-43b1-43f5-901f-215e796757ce None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.509219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 189/364] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.510738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.511021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.511291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.536152 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:00.537332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:00.609928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdbd44-000b-42dc-b8e8-72f428be4cc1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.611784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 190/365] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:00.612684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.651491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.652165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.652444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.652718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.653466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:00.653798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.655661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.665192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 176/366] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.666053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.735653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964e166-6c90-4df0-a728-c5d2a341ea9a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.781759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.782453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.782733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.783002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.783836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] RBAC: Adding query filter params (role.id=f12236030bf24b378a9e62e20138a0aa, user.id=6d30e7a83c274229b420e170ab6b77ad, scope.system=all) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:00.784175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.785593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.790100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c814c94-d080-4d0a-8f40-e9b2f988a12d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.797873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 191/367] 10.222.0.70 () {56 vars in 1308 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/role_assignments?user.id=6d30e7a83c274229b420e170ab6b77ad&scope.system=all&role.id=f12236030bf24b378a9e62e20138a0aa => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.798574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.833393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.834142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.834369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.835205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.836183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:00.836489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.838065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.844917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 177/368] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.846245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:00.919467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90a35-0c73-4cb8-8dda-def743d0086a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.957568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:00.958460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce27d74-c315-4ecd-981c-57f4cf0e9b92 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:00.959444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:00.960470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:00.960931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:00.967349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:00.968719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:00.977871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 192/369] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:00.980251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.011098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.012758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.013256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.013934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.033273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:01.042298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:01.043306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:01.044072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:01.046643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 178/370] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:01.047641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.125520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6ff4-df00-4bc0-bca2-d09f192c1ce3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:01.174835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.175174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.175420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.175696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.197604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759983-b04e-4675-b630-eabac911d7d6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:01.234899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.235558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.235833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.236102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.237010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:01.237316 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:01.239122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:01.246861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 179/371] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:01.247713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.281637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:01.283403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:01.418666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b28a2-6530-4c23-8af5-e9cc8b4806de None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:01.457982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 193/372] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:01.459333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.460148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.460429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.460704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.461470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:01.461794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:01.463585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:01.466176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.481557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 180/373] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:01.487360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.608984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dce3a-5352-43a0-a97b-f541f23f7635 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:01.629078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60656a66-0109-469c-ad42-0a5e8a7d1c18 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:01.651415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.652085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.652424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.652700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.670304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.671171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.671446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.671713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.679100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:01.680640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:01.682850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 194/374] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:01.688278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.731107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:01.732513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:01.823528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fec203-e7c9-4b93-9660-da7fe18f4db6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:01.837141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 181/375] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:43:01.846167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.879096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:01.879973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:01.880250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:01.880517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:01.886578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:01.888193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:01.890214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 195/376] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:01.895911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:01.964347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe5f36-9c2b-4297-b8d2-db3eed3e08f6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:02.007491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:02.008301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.008579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.008855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] PATH_INFO: `/v3/projects/eca989f1268f4da189675a074fd55f83` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.011891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] RBAC: Authorizing `identity:get_project(project_id=eca989f1268f4da189675a074fd55f83)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:02.013349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:02.015103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 182/377] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/projects/eca989f1268f4da189675a074fd55f83 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:02.021853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:02.077399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c7a4-b603-4ad0-ac0d-e58d383da70e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:02.131748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:02.132774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.133415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.136067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:02.137342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:02.141766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d995637-c2e5-4e07-9639-c9015728e632 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:02.152320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 196/378] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:01 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:02.172071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585abe78-4ddb-4f4e-8845-2537af24d7e3 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.174672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585abe78-4ddb-4f4e-8845-2537af24d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.175281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585abe78-4ddb-4f4e-8845-2537af24d7e3 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.177167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 197/379] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:02.185407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.185983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.186472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.216401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:02.217525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:02.247482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d70c3-b5e2-4bf2-b48c-72daed4159eb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:02.315864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:02.316675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.316950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.317219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] PATH_INFO: `/v3/groups/f9efcf57df004deda278bc8e3e66e1df` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.330573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] RBAC: Authorizing `identity:get_group(group_id=f9efcf57df004deda278bc8e3e66e1df)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:02.332383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:02.335287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 183/380] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:02 2022] GET /identity/v3/groups/f9efcf57df004deda278bc8e3e66e1df => generated 229 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:02.338564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 198/381] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:02.353494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:02.387273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:02.509166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7af07-eee4-41a7-8ef8-baeedf029813 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:02.551797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:02.552457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.552732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.552997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.554438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] RBAC: Adding query filter params (group.id=f9efcf57df004deda278bc8e3e66e1df, role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=eca989f1268f4da189675a074fd55f83) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:02.554742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:02.556179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:02.560039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027c9c9-878f-4e8c-a13f-6b5e89346fc5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:02.567586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 184/382] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:02 2022] GET /identity/v3/role_assignments?group.id=f9efcf57df004deda278bc8e3e66e1df&scope.project.id=eca989f1268f4da189675a074fd55f83&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:02.635421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:02.636290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.636574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.636848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.648543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:02.656391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:02.657301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:02.658944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 199/383] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:02.664112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:02.807172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05854d3d-07ac-41a7-b5e1-510c8a2c0a25 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:02.844817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:02.845499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:02.845789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:02.846058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:02.846810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:02.847111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:02.848497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:02.857272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 185/384] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:02.862585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:03.002242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5c946-5235-4253-a2ba-2b5a16aeaf82 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:03.039245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:03.040153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:03.040435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:03.040705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:03.041924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:03.043375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:03.045380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 200/385] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:02 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:03.050523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:03.198784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfd285-fd29-4f74-a5cb-c28fc488e494 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:03.239684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a632f-5b0c-45fc-9e97-b34f92795dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:03.240839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a632f-5b0c-45fc-9e97-b34f92795dd7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:03.241277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a632f-5b0c-45fc-9e97-b34f92795dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:03.241695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a632f-5b0c-45fc-9e97-b34f92795dd7 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:03.243173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a632f-5b0c-45fc-9e97-b34f92795dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:03.244771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a632f-5b0c-45fc-9e97-b34f92795dd7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:03.246641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 186/386] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:03 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:03.252379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:03.392872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3cbcb-5bd1-4ddc-9d2c-6bd221fee1f0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:03.450030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f2249-c5e5-4342-8354-ce9e69e03bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:03.450845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f2249-c5e5-4342-8354-ce9e69e03bc8 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:03.451120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f2249-c5e5-4342-8354-ce9e69e03bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:03.451390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f2249-c5e5-4342-8354-ce9e69e03bc8 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/groups/60a8d7c547cc4faca025650fafa584e9/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:03.459028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f2249-c5e5-4342-8354-ce9e69e03bc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb3030e3ef945a6a8787c4f1023bd8a, group_id=60a8d7c547cc4faca025650fafa584e9, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:03.460522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f2249-c5e5-4342-8354-ce9e69e03bc8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:03.486554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 201/387] 10.222.0.70 () {58 vars in 1442 bytes} [Mon May 16 16:43:03 2022] PUT /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/groups/60a8d7c547cc4faca025650fafa584e9/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:03.806518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7e0e-2a67-4222-bc27-ced83db34555 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:03.806863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7e0e-2a67-4222-bc27-ced83db34555 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:03.807041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7e0e-2a67-4222-bc27-ced83db34555 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:03.808379 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 187/388] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:03.813862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5f22-0367-40cd-9f28-91891618610e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:03.814148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5f22-0367-40cd-9f28-91891618610e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:03.814426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5f22-0367-40cd-9f28-91891618610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:03.832559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-363b5f22-0367-40cd-9f28-91891618610e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:03.833724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-363b5f22-0367-40cd-9f28-91891618610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:03.903166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 202/389] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:03.927010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b7e0e-2a67-4222-bc27-ced83db34555 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:04.034190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b7e0e-2a67-4222-bc27-ced83db34555 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:04.071588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:04.072313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.072574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.072844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.085523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:04.093331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:04.094331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:04.096048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 188/390] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:04.101305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5f22-0367-40cd-9f28-91891618610e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:04.200937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5f22-0367-40cd-9f28-91891618610e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:04.238755 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:04.239447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.239724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.239997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.240805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:04.241110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:04.242587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:04.252521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 203/391] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:04.258204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:04.395892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37a93b-647c-46a1-b2bb-9235aefd0ff3 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:04.440327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062cfba-85b8-40c6-9715-86253fc270da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:04.441187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062cfba-85b8-40c6-9715-86253fc270da None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.441465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062cfba-85b8-40c6-9715-86253fc270da None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.441750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062cfba-85b8-40c6-9715-86253fc270da None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.442958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062cfba-85b8-40c6-9715-86253fc270da None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:04.444996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062cfba-85b8-40c6-9715-86253fc270da None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:04.446967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 189/392] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:04 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:04.452088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:04.455045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b1f4-28cc-4298-9991-5548bde1fd6e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.455333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b1f4-28cc-4298-9991-5548bde1fd6e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.455608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b1f4-28cc-4298-9991-5548bde1fd6e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.456922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 190/393] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:04.467863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.468157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.468424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.499124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:04.500313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:04.627122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 191/394] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:04.629005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39cb3b-7fde-4c44-9dfc-a51556751e6e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:04.661429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:04.672990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:04.675471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.676643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.677321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.681195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:04.682940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:04.691048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 204/395] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:04 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:04.695120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:04.839637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960bcb4-3cd8-424d-b4fb-ceaaf91360f0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:04.875314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6c83-d5b2-483f-bb73-7519a1608085 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:04.888235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:04.889126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.889401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.889671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/groups/60a8d7c547cc4faca025650fafa584e9/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.893105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] RBAC: Authorizing `identity:create_grant(project_id=d8d6c330c4124e229a4ac616e449f8c4, group_id=60a8d7c547cc4faca025650fafa584e9, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:04.894588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:04.918690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 205/396] 10.222.0.70 () {58 vars in 1442 bytes} [Mon May 16 16:43:04 2022] PUT /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/groups/60a8d7c547cc4faca025650fafa584e9/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:04.939726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:04.940570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:04.940846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:04.941116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:04.966955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:04.975140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:04.976716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:04.977604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 192/397] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:04.982959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.124145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0001a-2309-4857-8a25-00a0cd54ec3b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.168561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.169321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.169577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.169885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.170652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:05.170955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:05.172359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d36f5e-1ef2-4525-8d03-aa46e8fb2f53 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:05.185672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 206/398] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:05.191076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.217987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9e39-ab02-4312-9253-4d2abb1030a7 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.218284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9e39-ab02-4312-9253-4d2abb1030a7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.218548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9e39-ab02-4312-9253-4d2abb1030a7 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.220348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 207/399] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:05.226133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.226448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.226685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.248052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:05.249254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:05.344465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 208/400] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:05.359953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6295-683d-4682-82e3-8f9d95fca99c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.378219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.401577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.402720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.403157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.403581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.406344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:05.407973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:05.413135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 193/401] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:05.421826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.529154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b41a30-4b22-4e8e-827e-a79bad36c392 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.565990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b36e4-0b64-4f0d-81b8-e46e0a0e55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.566808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b36e4-0b64-4f0d-81b8-e46e0a0e55e7 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.567088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b36e4-0b64-4f0d-81b8-e46e0a0e55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.567362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b36e4-0b64-4f0d-81b8-e46e0a0e55e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.579844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b36e4-0b64-4f0d-81b8-e46e0a0e55e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-cf8b36e4-0b64-4f0d-81b8-e46e0a0e55e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:05.590226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:05.591109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:05.591902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:05.592512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 209/402] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:05.596519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139546e3-1843-4e2e-b46c-79db0c9e0643 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.596519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139546e3-1843-4e2e-b46c-79db0c9e0643 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.596519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139546e3-1843-4e2e-b46c-79db0c9e0643 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.596519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 210/403] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:05.601160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139546e3-1843-4e2e-b46c-79db0c9e0643 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.603853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cd4db-1adf-4929-87e9-73ade563436b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.639411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced32caf-fb17-4902-913d-6595c0b85bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.640266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32caf-fb17-4902-913d-6595c0b85bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.640538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32caf-fb17-4902-913d-6595c0b85bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.640866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced32caf-fb17-4902-913d-6595c0b85bd0 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.642141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced32caf-fb17-4902-913d-6595c0b85bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:05.643723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced32caf-fb17-4902-913d-6595c0b85bd0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:05.645693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 194/404] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:05.651441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.651721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.651991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.668064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:05.669219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:05.715270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139546e3-1843-4e2e-b46c-79db0c9e0643 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.750469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.751204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.751568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.751885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.752731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:05.753143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:05.759253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:05.759380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 195/405] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:05.759380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.771570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 211/406] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:05.777232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.868634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fd1fb-4527-47f8-831f-e3ab4b8b1bf1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.902347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddcf38-b2dc-4d99-b73b-f63dff947bdb None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:05.904127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.905770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.905770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.905770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/groups/60a8d7c547cc4faca025650fafa584e9/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.907998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb3030e3ef945a6a8787c4f1023bd8a, group_id=60a8d7c547cc4faca025650fafa584e9, role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:05.909486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:05.924789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 196/407] 10.222.0.70 () {58 vars in 1442 bytes} [Mon May 16 16:43:05 2022] PUT /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a/groups/60a8d7c547cc4faca025650fafa584e9/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:05.925668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:05.944665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:05.946496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:05.947039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:05.947585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:05.949290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:05.951105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:05.954172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 212/408] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:05.963570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.124232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a047989-2ad9-4e48-ad19-5dc957218a10 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.152394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ae4b2-4f98-4f72-b64b-311adbb3967b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.158163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.159016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.159288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.159556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.160722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.162192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.164215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 213/409] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:06.170739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.193469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.194969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.195527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.195804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.211689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:06.220305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:06.221193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:06.222024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 197/410] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:06.228802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.291272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371f67-636b-4a64-986d-579c5d29d14a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.329105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.330014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.330287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.330556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/groups/60a8d7c547cc4faca025650fafa584e9/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.332742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8d6c330c4124e229a4ac616e449f8c4, group_id=60a8d7c547cc4faca025650fafa584e9, role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.334216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.349425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 214/411] 10.222.0.70 () {58 vars in 1442 bytes} [Mon May 16 16:43:06 2022] PUT /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4/groups/60a8d7c547cc4faca025650fafa584e9/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:43:06.377399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086f6e8-eb31-4698-a1c6-083ac8bf3c8c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.421768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.421768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.421768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.421768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.422184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:06.422184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.422184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f371666-5478-47ee-a946-8f50ee3cab2f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.426559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 198/412] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:06.432563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.506253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c546c8-77f9-43b2-8052-6cf14eaa9d56 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.507453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c546c8-77f9-43b2-8052-6cf14eaa9d56 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.507934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c546c8-77f9-43b2-8052-6cf14eaa9d56 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.509920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 199/413] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:06.516046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.516641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.517140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.534404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:06.535927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:06.539545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d809-864e-46d7-93b6-4b42f80ef389 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.584008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.584979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.585866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.586768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] PATH_INFO: `/v3/groups/f9efcf57df004deda278bc8e3e66e1df` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.588533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] RBAC: Authorizing `identity:get_group(group_id=f9efcf57df004deda278bc8e3e66e1df)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.590721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.593424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 215/414] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:06 2022] GET /identity/v3/groups/f9efcf57df004deda278bc8e3e66e1df => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:06.599010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.606712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 200/415] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:06.632098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.701278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb015ef-8079-4444-97e1-75e5d6b9cc3e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.734163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7987a4-a7d0-4408-962a-c91904f83acd None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.741831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.743021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.743505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.744058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] PATH_INFO: `/v3/projects/eca989f1268f4da189675a074fd55f83` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.745437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] RBAC: Authorizing `identity:get_project(project_id=eca989f1268f4da189675a074fd55f83)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.747094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.749303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 216/416] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:06 2022] GET /identity/v3/projects/eca989f1268f4da189675a074fd55f83 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:06.754939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.771763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.772667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.772947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.773220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.785071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:06.793631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:06.794546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:06.795342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 201/417] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:06.800945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:06.862018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb55b14-33b8-4192-a706-d568523f747e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.902085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.903298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.903765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.904238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] PATH_INFO: `/v3/projects/eca989f1268f4da189675a074fd55f83/groups/f9efcf57df004deda278bc8e3e66e1df/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.906701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] RBAC: Authorizing `identity:create_grant(project_id=eca989f1268f4da189675a074fd55f83, group_id=f9efcf57df004deda278bc8e3e66e1df, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.909098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.917761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc8f7b-45fb-4ede-84ea-ab328bcce592 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:06.937203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 217/418] 10.222.0.70 () {58 vars in 1442 bytes} [Mon May 16 16:43:06 2022] PUT /identity/v3/projects/eca989f1268f4da189675a074fd55f83/groups/f9efcf57df004deda278bc8e3e66e1df/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:43:06.963985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:06.964782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:06.965065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:06.965409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:06.966264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] RBAC: Adding query filter params (name=member) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:06.966611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:06.968059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:06.983410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 202/419] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:06.989597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:07.124795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5334c-7d23-4bcb-ba8f-9a5d29c3938e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:07.159678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7a39-8be5-452e-bef2-ab639a1f2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:07.160247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7a39-8be5-452e-bef2-ab639a1f2d73 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.160522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7a39-8be5-452e-bef2-ab639a1f2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.160788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7a39-8be5-452e-bef2-ab639a1f2d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.249500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7a39-8be5-452e-bef2-ab639a1f2d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:07.251122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7a39-8be5-452e-bef2-ab639a1f2d73 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:07.364890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:07.368158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 218/420] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:07.516001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37ecff-735b-40e1-ad6b-7461f9fba46c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:07.531644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dae1c-44a9-4884-bbfb-a0672dbddcb9 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.531986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dae1c-44a9-4884-bbfb-a0672dbddcb9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.532261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dae1c-44a9-4884-bbfb-a0672dbddcb9 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.533844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 219/421] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:07.539681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.540201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.540668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.558240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:07.559835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:07.566700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:07.567574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.567854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.568133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.573785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:07.573785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:07.573785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 203/422] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:07 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:07.589475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:07.683332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 220/423] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:07.698934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843428f-8558-4df2-89c7-bd5a26f86783 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:07.722782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:07.732641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:07.733500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.733798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.734075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.735256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:07.736691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:07.738931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 204/424] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:07 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:07.746673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:07.899854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbee56-7b38-433f-82f6-8a88ab7d95d2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:07.904020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119618-86c0-4674-882f-7f5c0a48c59b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:07.958810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:07.960414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.960855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.961271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.971311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:07.972006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:07.972232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:07.972505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:07.972919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:07.973332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:07.973640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:07.975150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:07.981764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:07.982814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 16 16:43:07.983816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:07.986130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 221/425] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:07.989834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 205/426] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:07 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:07.992329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:08.113812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02516b9-480c-438a-ad83-542bc56093d9 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:08.151307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:08.152240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:08.152666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:08.153082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:08.154010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] RBAC: Adding query filter params (name=member) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:08.154531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:08.156189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:08.166620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 222/427] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:08.172418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:08.285424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a20a9a-a8dd-423f-9f2d-fdbf15e5e584 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:08.319804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:08.320691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:08.321115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:08.321534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:08.390191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:08.395013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:08.511452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 206/428] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:08.517161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:08.627108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413f0f-878a-41c1-91e8-7f1bdd99c329 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:08.662365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d67bf-375a-40ac-9cd8-9edd64bc50c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:08.663496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d67bf-375a-40ac-9cd8-9edd64bc50c4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:08.663920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d67bf-375a-40ac-9cd8-9edd64bc50c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:08.664357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d67bf-375a-40ac-9cd8-9edd64bc50c4 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:08.665684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d67bf-375a-40ac-9cd8-9edd64bc50c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:08.667317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d67bf-375a-40ac-9cd8-9edd64bc50c4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:08.669178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 223/429] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:08 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:08.674751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:08.785943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3614f5-0dbd-4e77-9ebd-263829e88906 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:08.786569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3614f5-0dbd-4e77-9ebd-263829e88906 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:08.787064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3614f5-0dbd-4e77-9ebd-263829e88906 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:08.787924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3213773-414f-4cf0-9474-9d4c191a92d4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:08.789133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 224/430] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:08.794713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:08.795248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:08.795749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:08.813132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:08.814681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:08.839291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:08.840155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:08.840430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:08.840706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:08.842030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:08.843388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:08.845042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 207/431] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:08 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:08.853961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:08.910172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 225/432] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:08.930242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:08.995515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d69f-a6cd-4060-9570-b65a237483d0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.038149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.039319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.039753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.040168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.040793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2faf96-0859-4f5c-9a62-3cd67b652d32 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.041633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=e88b00d27c2f432c9dd8cefff2ee1371, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:09.042125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:09.044689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:09.052201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 208/433] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:08 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=e88b00d27c2f432c9dd8cefff2ee1371 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:09.091076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.092007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.092354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.092727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.104440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:09.112709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:09.113952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:09.114744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:09.116464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 226/434] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:09.121983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.240286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ab472-5c63-4168-a33b-e17b7394017b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.275478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.276152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.276430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.276703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.277459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:09.277789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:09.279303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1806c1c-7436-4c18-8f8c-14f575ca8ab4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:09.292922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 209/435] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:09.299088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.387838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d8ef-35fa-4ee8-a39f-7794f8d3d84f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.388465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d8ef-35fa-4ee8-a39f-7794f8d3d84f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.388942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d8ef-35fa-4ee8-a39f-7794f8d3d84f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.391538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 210/436] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:09.397581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.397892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.398157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.405491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c10a9d-dc00-4ffa-a577-dd9db2f81df4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.415281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:09.416276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:09.446879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.447529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.447807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.448077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.483062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 211/437] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:09.505552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.513121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:09.514639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:09.608006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72934250-15b6-476c-9fea-a0ffbff5a3cc None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.614103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 227/438] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:09.619966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.654500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.655582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.655857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.656123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.666423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:09.674227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:09.675131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:09.676089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 212/439] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:09.681022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.720217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e1e4-4f8c-4ed8-ad3d-c4d0cc226968 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.752611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.753716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.754180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.754599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] PATH_INFO: `/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.755866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb3030e3ef945a6a8787c4f1023bd8a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:09.757855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:09.759914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 228/440] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/projects/dcb3030e3ef945a6a8787c4f1023bd8a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:09.764826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.782843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bface2-afc4-411c-8933-b7436c36741d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.814534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.815195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.815471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.815741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.816476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:09.816775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:09.818194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae9aa-36c0-4cfc-a61b-d9599c6cf70e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:09.826148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 213/441] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:09.827394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4f94-dbfd-4c79-b591-865436104ce0 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.827678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4f94-dbfd-4c79-b591-865436104ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.827953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc4f94-dbfd-4c79-b591-865436104ce0 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.829162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 214/442] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:09.831355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4f94-dbfd-4c79-b591-865436104ce0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:09.860353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a34b42-516f-4d22-9bd3-2bbca5881106 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.891746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a2835-7704-48c5-a1f8-0d07970aa365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.892578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a2835-7704-48c5-a1f8-0d07970aa365 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.892847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a2835-7704-48c5-a1f8-0d07970aa365 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.893112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a2835-7704-48c5-a1f8-0d07970aa365 None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.894296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a2835-7704-48c5-a1f8-0d07970aa365 None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:09.895743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a2835-7704-48c5-a1f8-0d07970aa365 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:09.897936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 229/443] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:09.899041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.899313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.899576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.914881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:09.916018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:09.925604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc4f94-dbfd-4c79-b591-865436104ce0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:09.957201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:09.957939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:09.958214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:09.958480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:09.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 230/444] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:09.977974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.021113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.023051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.080808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e5b65-76ea-4d8d-a7ff-9d794da672c9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.111116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 215/445] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:43:10.112035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.112680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.113223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.113493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.114343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:10.114653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.116673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.117017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.122453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 231/446] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:09 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=dcb3030e3ef945a6a8787c4f1023bd8a&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:10.123215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.217301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889316b7-fefb-47a1-b130-0f34f92b020e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.225474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379489c0-e427-41db-be9b-708f106e8937 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.252251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.253188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.253322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.253589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.261838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.262718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.262999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.263273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] PATH_INFO: `/v3/projects/d8d6c330c4124e229a4ac616e449f8c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.264542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] RBAC: Authorizing `identity:get_project(project_id=d8d6c330c4124e229a4ac616e449f8c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.265337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:10.266043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.268004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 232/447] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/projects/d8d6c330c4124e229a4ac616e449f8c4 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:10.273313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:10.274243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:10.275515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:10.276338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.276412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 216/448] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:10.280408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.378106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ceb24-692d-4e44-af3c-62de7bb00e14 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.389823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736241d-36cd-41ff-88a7-6978b04d8108 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.415020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.416361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.417150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.417150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] PATH_INFO: `/v3/groups/60a8d7c547cc4faca025650fafa584e9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.418162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] RBAC: Authorizing `identity:get_group(group_id=60a8d7c547cc4faca025650fafa584e9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.419624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.421248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 233/449] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/groups/60a8d7c547cc4faca025650fafa584e9 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:10.426962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.432250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.432919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.433193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.433458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.434251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:10.434553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.435930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.444839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 217/450] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:10.450458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.532164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b991cc6-15f4-4cec-8d02-ee2e9ab940bb None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.565853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.566512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.566795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.567062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.567884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] RBAC: Adding query filter params (group.id=60a8d7c547cc4faca025650fafa584e9, role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=d8d6c330c4124e229a4ac616e449f8c4) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:10.568189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.568453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51a7f-4236-4fae-a0f8-c1b2200d5df3 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.570235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.576385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 234/451] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/role_assignments?group.id=60a8d7c547cc4faca025650fafa584e9&scope.project.id=d8d6c330c4124e229a4ac616e449f8c4&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:10.609608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.610306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.610583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.610854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.687621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.689122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.794830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 218/452] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:43:10.800383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:10.897537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa2ce-609f-4a35-a56c-2e873a0ecf0d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:10.929516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:10.930414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:10.930686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:10.930955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] PATH_INFO: `/v3/projects/eca989f1268f4da189675a074fd55f83` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:10.932114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] RBAC: Authorizing `identity:get_project(project_id=eca989f1268f4da189675a074fd55f83)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:10.933540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:10.935238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 235/453] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/projects/eca989f1268f4da189675a074fd55f83 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:10.940679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:11.032420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca15a-6f8b-4863-be37-4591228c6149 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:11.063436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c278-b343-470f-bd16-bf0d63409a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:11.064212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c278-b343-470f-bd16-bf0d63409a5f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:11.064491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c278-b343-470f-bd16-bf0d63409a5f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:11.064755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c278-b343-470f-bd16-bf0d63409a5f None admin] PATH_INFO: `/v3/groups/f9efcf57df004deda278bc8e3e66e1df` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:11.065918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8c278-b343-470f-bd16-bf0d63409a5f None admin] RBAC: Authorizing `identity:get_group(group_id=f9efcf57df004deda278bc8e3e66e1df)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:11.067341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8c278-b343-470f-bd16-bf0d63409a5f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:11.068941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 219/454] 10.222.0.70 () {56 vars in 1180 bytes} [Mon May 16 16:43:10 2022] GET /identity/v3/groups/f9efcf57df004deda278bc8e3e66e1df => generated 229 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:11.074702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:11.167050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cf3a4-36af-4bb8-94a9-1dab39b08fab None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:11.201209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:11.201878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:11.202156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:11.202419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:11.203240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] RBAC: Adding query filter params (group.id=f9efcf57df004deda278bc8e3e66e1df, role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=eca989f1268f4da189675a074fd55f83) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:11.203540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:11.204957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87b04-63ba-4b35-afda-068c921e6b84 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:11.213841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 236/455] 10.222.0.70 () {56 vars in 1376 bytes} [Mon May 16 16:43:11 2022] GET /identity/v3/role_assignments?group.id=f9efcf57df004deda278bc8e3e66e1df&scope.project.id=eca989f1268f4da189675a074fd55f83&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:13.787142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f629-6f54-487b-98cc-576020c0c1f4 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:13.788107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f629-6f54-487b-98cc-576020c0c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:13.788532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750f629-6f54-487b-98cc-576020c0c1f4 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:13.790337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 220/456] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:13.811733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e3eb-a23e-479d-8e59-8b237e06bbf4 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:13.812555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e3eb-a23e-479d-8e59-8b237e06bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:13.812971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e3eb-a23e-479d-8e59-8b237e06bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:13.838276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d6c8e3eb-a23e-479d-8e59-8b237e06bbf4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:13.839480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d6c8e3eb-a23e-479d-8e59-8b237e06bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:13.925480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 237/457] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:13.967735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f629-6f54-487b-98cc-576020c0c1f4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.109610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750f629-6f54-487b-98cc-576020c0c1f4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.114970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4c4ae-b249-4614-80d8-6fc85d4cc083 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.116077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4c4ae-b249-4614-80d8-6fc85d4cc083 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.116551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4c4ae-b249-4614-80d8-6fc85d4cc083 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.118409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 238/458] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:14.123752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44390018-e20f-405d-824f-015768760d40 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.124290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44390018-e20f-405d-824f-015768760d40 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.124759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44390018-e20f-405d-824f-015768760d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.144291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-44390018-e20f-405d-824f-015768760d40 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:14.145841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-44390018-e20f-405d-824f-015768760d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:14.166570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.167411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.167638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.167911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.185607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.186981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:14.213892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:14.214791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:14.215624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:14.215624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:14.215624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:14.215624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:14.215624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 221/459] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:14.220935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.253957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 239/460] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:14.255619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f4f1-0110-42ab-821b-b742626b137b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.256143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f4f1-0110-42ab-821b-b742626b137b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.256617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f4f1-0110-42ab-821b-b742626b137b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.258134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 240/461] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:14.263700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.264199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.264809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.288445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:14.289844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:14.342483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2038-cbf1-4f0f-82da-37d5dcb9ce43 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.357618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 241/462] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:14.358876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.401022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.401799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.402184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.402559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.403389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:14.403798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.405271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.421721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 222/463] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:14.427181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.485964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c418c3a-f972-44d0-91d7-24d7adb7ad3e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.526303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8352a-0144-42e6-a426-02fb4a9111a0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.530338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.531351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.531770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.532178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.545763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.548232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.560967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.561762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.562046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.562311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:14.569476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:14.570337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:14.571195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:14.571195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:14.571195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:14.571195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:14.571195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 242/464] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:14.573317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.573723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.575228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c7911971-f49a-4417-b0d2-56c5ece603c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:14.591935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:14.592821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:14.593678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:14.593678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:14.593678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:14.593678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:14.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 223/465] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:14.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633346-12bd-4b9b-81f6-4de0a72cb274 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633346-12bd-4b9b-81f6-4de0a72cb274 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7633346-12bd-4b9b-81f6-4de0a72cb274 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 224/466] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:14.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633346-12bd-4b9b-81f6-4de0a72cb274 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.676373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6437f-3b31-482a-aeb1-4609a6a41a10 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.706515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7633346-12bd-4b9b-81f6-4de0a72cb274 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.711258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.711925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.712202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.712471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.713165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.714657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.738046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 243/467] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:43:14 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:14.738046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.758178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.759664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.759664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.759664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.761444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:14.761444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.764340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52943d55-71cf-44f2-a5c1-e770d000384b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.786009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 225/468] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:14.787525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.788218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.788501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.811665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:14.812893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:14.851217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f72c22-c651-42d9-bc7b-2bc1cc32d819 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:14.886577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 226/469] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:14.887449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:14.897409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:14.898134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:14.898418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:14.898698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:14.899598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:14.916076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:14.916076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:14.936399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 244/470] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:14.937075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:15.003247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d7da6-2145-4501-84df-5d06fcc9fc02 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:15.041063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:15.041933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.042319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.042656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.043525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:15.044800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:15.074442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d0341-33d3-463a-8018-b11643e80419 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:15.074903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 227/471] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:43:14 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:15.075774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:15.117793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:15.119160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.119632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.120149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.133444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:15.135417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:15.156809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:15.157702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:15.158590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:15.158590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:15.158590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:15.158590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:15.161070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 245/472] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:15.168321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:15.292117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f4f2-6470-48a2-87e2-8856120034a3 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:15.314847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53359-9861-4710-b791-c5a25e43edc5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:15.334495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:15.335283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.335463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.335689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.336387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:15.339147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:15.360833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:15.361861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 228/473] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:43:15 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:15.362153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.362958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.363443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.364371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:15.364887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:15.367055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6cc3-d6d4-4367-a715-70d7051d4164 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:15.380587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 246/474] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:15.390964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:15.504934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424dde4-1c48-4c19-bb04-65f06d1d275d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:15.541651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ddb21-4673-462d-9368-c9fa266831f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:15.542407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddb21-4673-462d-9368-c9fa266831f9 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.542619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddb21-4673-462d-9368-c9fa266831f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.542884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ddb21-4673-462d-9368-c9fa266831f9 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.543619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ddb21-4673-462d-9368-c9fa266831f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:15.545063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ddb21-4673-462d-9368-c9fa266831f9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:15.580143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 229/475] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:43:15 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:15.653772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45692-6f73-4ff0-a700-3a7de5455764 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.654120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45692-6f73-4ff0-a700-3a7de5455764 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.654321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b45692-6f73-4ff0-a700-3a7de5455764 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.655970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 247/476] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:15.662064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.662958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.663292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.686846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:15.688129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:15.761252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 230/477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:15.785163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45692-6f73-4ff0-a700-3a7de5455764 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:15.893604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b45692-6f73-4ff0-a700-3a7de5455764 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:15.927509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:15.928537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:15.929008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:15.929483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:15.930459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:15.932020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:15.944371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.sql.core [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 16:43:15.944371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 16:43:15.944371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [parameters: {'id': 'f363e6dfab5c4a639bc140ea2817ba9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 16:43:15.944371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79955) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application result = self._query(query) May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application conn.query(q) May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application result.read() May 16 16:43:15.961548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return ref.to_dict() May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 16:43:15.963635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application next(self.gen) May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application yield resource May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application next(self.gen) May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self.session.rollback() May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self.force_reraise() May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise self.value May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application session.commit() May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 16:43:15.965099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._prepare_impl() May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self.session.flush() May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._flush(objects) May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application compat.raise_( May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application flush_context.execute() May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rec.execute(self) May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 16:43:15.967542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 16:43:15.969707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application result = self._query(query) May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application conn.query(q) May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application result.read() May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 16:43:15.971265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [parameters: {'id': 'f363e6dfab5c4a639bc140ea2817ba9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:15.982824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 16 16:43:15.987105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:15.989333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 248/478] 10.222.0.70 () {60 vars in 1131 bytes} [Mon May 16 16:43:15 2022] POST /identity/v3/roles => generated 144 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:15.989475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:16.082406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83572-48fd-429a-816c-ac1614dbb6ff None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:16.116180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb6473-477e-4533-91a0-9a36231c02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:16.116976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6473-477e-4533-91a0-9a36231c02e1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:16.117245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6473-477e-4533-91a0-9a36231c02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:16.117507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb6473-477e-4533-91a0-9a36231c02e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:16.127586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb6473-477e-4533-91a0-9a36231c02e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c6fb6473-477e-4533-91a0-9a36231c02e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:16.136152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:16.138156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:16.140032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 231/479] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:16.150843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:16.278626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3074de-d400-4e67-a466-cbd9a11606fd None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:16.326469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:16.327150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:16.327425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:16.327693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:16.328446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:16.328743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:16.330157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7918-ee3b-4200-b076-4d27766ab5e9 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:16.340140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 249/480] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:17.601680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce653c-7034-4952-99ef-87cb7c83900b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:17.602417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce653c-7034-4952-99ef-87cb7c83900b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:17.602417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce653c-7034-4952-99ef-87cb7c83900b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:17.603835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 232/481] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:17.608916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:17.609404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:17.609559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:17.630744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:17.631966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:17.712435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 250/482] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:17.767817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce653c-7034-4952-99ef-87cb7c83900b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:17.887463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce653c-7034-4952-99ef-87cb7c83900b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:17.921473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02bc18-c2c5-4fcd-845e-f257b9e18482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:17.922283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02bc18-c2c5-4fcd-845e-f257b9e18482 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:17.922558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02bc18-c2c5-4fcd-845e-f257b9e18482 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:17.922824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02bc18-c2c5-4fcd-845e-f257b9e18482 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:17.932943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02bc18-c2c5-4fcd-845e-f257b9e18482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-ed02bc18-c2c5-4fcd-845e-f257b9e18482 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:17.940584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:17.942628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:17.944347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 233/483] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:17.951054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:17.996956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659961f-7a7e-4500-9a60-b02a92d59faf None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:17.997245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659961f-7a7e-4500-9a60-b02a92d59faf None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:17.997415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659961f-7a7e-4500-9a60-b02a92d59faf None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:17.998764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 234/484] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:18.004084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.004365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.004633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.030829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:18.032027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:18.087019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55dc07-a3e9-452e-a41a-e0c5ffd23f0e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.125903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.126584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.126857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.127124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.128057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:18.128361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:18.129764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:18.140322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 251/485] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:18.147698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.200340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 235/486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:18.223729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.339238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f86a9-033f-4ca8-bfa8-e4e0f86b02c4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.347634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687dfdd-6c0c-4066-9955-322416da9a14 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.373404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.374657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.375130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.375586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.383193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728cdf4-bd4c-4d3e-9a33-dec8081f0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.383982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728cdf4-bd4c-4d3e-9a33-dec8081f0de2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.384251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728cdf4-bd4c-4d3e-9a33-dec8081f0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.384515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728cdf4-bd4c-4d3e-9a33-dec8081f0de2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.391982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:18.394868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728cdf4-bd4c-4d3e-9a33-dec8081f0de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:18.395184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c728cdf4-bd4c-4d3e-9a33-dec8081f0de2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:18.403197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:18.404148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:18.404949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 236/487] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:18.417341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:18.418307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:18.419166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:18.419166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:18.419166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:18.419166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:18.420396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd09b-01b4-4cd0-98cd-7cc69b324017 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.420679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd09b-01b4-4cd0-98cd-7cc69b324017 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.420950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfd09b-01b4-4cd0-98cd-7cc69b324017 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.422539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 252/488] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:18.422730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 237/489] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:18 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:18.423657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.432647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.432936 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.433216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.450902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:18.452064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:18.525893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 238/490] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:18.526833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.550432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501c5e-e858-492e-85f4-3d4ea5cea348 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.587965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.588356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.588638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.588909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.589713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:18.589989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:18.591423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:18.600324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 253/491] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:18.605033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.656300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067dc9-5d2d-49d5-889a-5cc9574941df None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.695117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.695810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.696087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.696360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.697069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:18.697373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:18.698770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:18.714650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 239/492] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:18.714836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d77d2e-e735-43c6-b1d0-adfc97b997f5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.715278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.745996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfade9f-78d5-49db-bf0d-e4b1ef71a8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.746794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfade9f-78d5-49db-bf0d-e4b1ef71a8ae None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.747072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfade9f-78d5-49db-bf0d-e4b1ef71a8ae None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.747346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfade9f-78d5-49db-bf0d-e4b1ef71a8ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.757861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfade9f-78d5-49db-bf0d-e4b1ef71a8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6cfade9f-78d5-49db-bf0d-e4b1ef71a8ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:18.765574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:18.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:18.767275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 254/493] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:18.773146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d244a-8b01-47d4-a10e-ffa969474eb5 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.773430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d244a-8b01-47d4-a10e-ffa969474eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.773704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d244a-8b01-47d4-a10e-ffa969474eb5 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.775559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 255/494] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:18.776234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d244a-8b01-47d4-a10e-ffa969474eb5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.818206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cf325-017b-400c-8e74-26dbcf6ebd98 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.851454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.852160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.852435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.852703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.863010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:18.864472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:18.878460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d244a-8b01-47d4-a10e-ffa969474eb5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:18.881509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:18.882626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:18.883495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:18.883495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:18.883495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:18.883495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:18.883495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 240/495] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:18.883495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:18.917064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:18.917886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.918174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.918445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.925712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:18.927199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-da53cea1-803e-4f2f-8dac-c62801dd766a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:18.943235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:18.944686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 256/496] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:18.950285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:18.950948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:18.964113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:18.965471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:18.985829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31882d9-e257-459f-a51b-b80cdbead7c2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.019711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.020367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.020644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.020912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.022234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:19.022535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.023903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.037760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 257/497] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:19.037760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.038029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 241/498] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:19.038029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.134718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97932f4f-e4ef-4204-a14b-922c6306ca89 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.141018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2b3d7-557e-49f5-bd22-9355daea3d6c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.168455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.169123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.169531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.169833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.170552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:19.170853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.172238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.178341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.179064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.179412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.179744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.180690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:19.181057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.182565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.187930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 258/499] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:19.187930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.226775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 242/500] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:19.231942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.278715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67394c65-9e34-43ca-a138-1c1d128cd6ef None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.310068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.310848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.311125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.311393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.321283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.322767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.325237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2a176-002e-4d61-9f62-e77a28c0dd42 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:19.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:19.340403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:19.346016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:19.346016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:19.346016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:19.346016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:19.346016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 259/501] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:19.346016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.359161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.359942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.360215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.360488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.370363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:19.377860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:19.378896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:19.379722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 243/502] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:19.380364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.437908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1455-065e-42b8-95d4-8974a95b9c4b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.470740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.471520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.471794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.472058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.475060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb0ac3-7445-4f0e-927d-c564f4146f5f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.479181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.480630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-660e8f42-92cc-4419-8846-0d8fb7001c69 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:19.494456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:19.495340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:19.496203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 260/503] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:19.497203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde86e-e2b8-4a86-9f68-d74b074ca242 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.497203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde86e-e2b8-4a86-9f68-d74b074ca242 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.497434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde86e-e2b8-4a86-9f68-d74b074ca242 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.498715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 261/504] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:19.499400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde86e-e2b8-4a86-9f68-d74b074ca242 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.508909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.509552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.509871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.510149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.572344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.573837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.593434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde86e-e2b8-4a86-9f68-d74b074ca242 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.625151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.625812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.626085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.626351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.627054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:19.627354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.628700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.639738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 262/505] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:19.640513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.665588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 244/506] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:19.666393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.732383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e767c7-02d6-4269-ad1f-cfff9bd6f8f6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.760861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f63bf-945f-415d-8215-3c13e0d055a5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.763949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.764611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.764891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.765164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.765938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:19.766242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.767611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb59a-fe83-4343-aca9-c76f82ff5640 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.775804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 263/507] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:19.776974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.777255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.777525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.792634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:19.792769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.793302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.793574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.793833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:19.793947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.794679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:19.794976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.796398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.812914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 245/508] 10.222.0.70 () {56 vars in 1137 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:19.813699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.858289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 264/509] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:19.858961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.906324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c2ccb-8756-4542-8fe7-eef86d8c770a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.937245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.937989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.938262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.938524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.945615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.947164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:19.954809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b1914-28c6-4285-a7f3-c1311ffb34d8 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:19.962125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:19.962992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:19.963888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 246/510] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:19.964431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:19.986797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:19.987835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:19.988117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:19.988381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:19.998334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:19.999780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:20.016977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:20.018014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:20.019030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:20.019030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:20.019030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.019030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:20.019030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 265/511] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:20.019509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.060249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4503c04-9efe-4746-9e8a-e7f94b482a5d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.091090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.091858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.092126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.092388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.102332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.103800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.109918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1473f-ed87-4d7f-9f1d-d65348a915ce None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:20.120728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:20.121710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:20.122775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:20.122775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:20.122775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.122775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:20.122775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 247/512] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:20.122775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.144886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.145526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.145838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.146114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.208519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.209939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.213842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ecb6-a1bf-416c-9fe4-658ecc4b0b1c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.245092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.245884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.246156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.246422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.256315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.257758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:20.273871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:20.274869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:20.275863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:20.275863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:20.275863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.275863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:20.275863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 248/513] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:20.276151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.304316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 266/514] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:20.305157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.369584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec379d8-3016-400c-b958-42cd5cce0e38 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.395232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49008f84-15f5-4ba4-8193-fe86d66051a0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.399995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.400655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.400930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.401197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.402067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:20.402373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.403850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.423138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 249/515] 10.222.0.70 () {56 vars in 1137 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:20.423965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.430660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.431314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.431599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.431869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.432576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:20.432874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.434289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.445049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 267/516] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:20.445770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.516102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a6dba-0897-441c-bf76-8948dfef1ee8 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.536033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1f572-c6b5-4267-b44f-5e1a254efe51 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.547378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.548031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.548310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.548580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.549287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:20.549590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.550981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.561950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 250/517] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:20.562723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.567744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.568418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.568692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.568959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.569662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:20.569996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.571352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.582476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 268/518] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:20.583258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.656933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66791f77-eb65-46a1-a130-b146b8f6f816 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.674603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64729f-a12d-45c6-9552-49b95d949101 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.687831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.688604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.688878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.689147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.698938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.700366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.705641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.706305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.706575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.706845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:20.717185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:20.718219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:20.719049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:20.719049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:20.719049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:20.719049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:20.719049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 251/519] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:20.719311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.769789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.771249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.816158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9600e4-926b-4912-9ad0-dcfeb8808db9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.847338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.848106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.848378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.848643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.855427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.856877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:20.865722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 269/520] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:20.866584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:20.871888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:20.872749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:20.873579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 252/521] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:20.874522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:20.957937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718703d-093f-4b56-a159-37166f1a8b70 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.964354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66223bb-51fd-4557-90f8-ac90a0776de5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:20.990932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.991717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.991997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.992269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.997184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:20.997862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:20.998140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:20.998408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:20.998983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:20.999094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.000427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.000526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:21.014575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:21.015486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:21.016560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 270/522] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:21.017520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.033857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 253/523] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:43:20 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:21.033857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.128113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6d0b1-1c2a-4f62-9967-aa18c4d13d08 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.128325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3322a-1aa0-4b31-8ca6-48b984bfb744 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.161128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.161955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.162726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.162841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.162990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.163420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.163791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.165784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.165784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.165784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.166390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.174399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.175921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.180820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 271/524] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:21.181692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:21.195533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:21.196480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:21.197308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:21.197308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:21.197308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:21.197308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:21.202408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 254/525] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:21.202751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.290845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1966a3-a3d2-4ec1-9c21-41f857f02955 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.301424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093661c-4a6a-4ed5-bb19-d92922c420ed None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.323377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.324026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.324298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.324763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.325331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.325629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.327096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.336098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.336997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.337469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.337962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.338801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.339108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.340524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.350254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 272/526] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:21.350254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.359529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 255/527] 10.222.0.70 () {56 vars in 1139 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:21.360567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.455803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d892eb-2c28-4ce6-8aa7-58f48a4d46d5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.463451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36946-6178-4a12-be38-9ca5964e800a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.491610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.492508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.492851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.493189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.496726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.497387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.497666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.497971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.498684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.498989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.500368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.500590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.502126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.516025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 256/528] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:21.516025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:21.516237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:21.517002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 273/529] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:21.523079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.608199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d904-7af6-43e2-b207-a727b578a570 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.619262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4148a7-9e6c-4bfc-8620-6fe407af03b6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.639715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.640595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.641009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.641409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.642396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=fc0134f8e7c1401eb79c443f67174a0f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.642836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.644425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.650579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 257/530] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/role_assignments?user.id=fc0134f8e7c1401eb79c443f67174a0f&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:21.651474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.661697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.663283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.663765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.664171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.738082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.739803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.759242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247a69-2207-4566-a42a-e555a363fe51 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.796774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.797586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.797904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.798161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.805766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.807224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:21.823276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:21.824353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 258/531] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:21.825335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.856694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 274/532] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:21.858147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:21.935061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041ff58-d286-4510-8fe5-b91095677375 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.957360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21860c-ed72-4f39-ba84-78fefda3d155 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:21.969632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.970557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.971029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.971466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.972426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.972898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.975262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:21.992343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:21.993099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:21.993446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:21.993812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:21.994433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 259/533] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:21.999455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:21.999455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:21.999455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.000634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.013783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 275/534] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:22.013783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.107150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b9918-a43a-4f6a-87cc-8a617e530d1a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:22.107724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9c456-1205-4a43-b7aa-ec08b2b6f35d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:22.141164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:22.141844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:22.142126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:22.142396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:22.142877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:22.143224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=9e3e792f55154143932d62ac460022b1) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:22.143531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:22.144325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:22.144786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:22.144968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.145412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:22.157718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 276/535] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:22 2022] GET /identity/v3/role_assignments?user.id=9e3e792f55154143932d62ac460022b1&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:22.157718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.164345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:22.166097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:22.197203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:22.198141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:22.198954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:22.198954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:22.198954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:22.198954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:22.203874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 260/536] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:22.205443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.304719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0ab62-2eb2-428f-aa25-1db4d88a2fe3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:22.344405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:22.345081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:22.345361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:22.345642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:22.346514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=c3d39e375e994373b5bd403baa053e45) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:22.346824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:22.348300 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.355522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 277/537] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:22 2022] GET /identity/v3/role_assignments?user.id=c3d39e375e994373b5bd403baa053e45&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:22.434501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657465-a697-4a08-9555-bc768fdb7f75 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:22.510647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:22.511259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:22.511540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:22.511814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:22.512668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:22.512877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:22.514331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.531094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 261/538] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:22.536909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.638805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17b03-0259-4224-a5ef-dcd4cf215008 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:22.671955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:22.672743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:22.673023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:22.673339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:22.680955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:22.682372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:22.696840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:22.697695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:22.698567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 278/539] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:22.706937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.816017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac422f-857c-4563-a32d-15cafd98d66a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:22.850739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:22.851403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:22.851676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:22.851948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:22.852733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:22.853037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:22.854518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d51e79-4668-421d-90b0-5b458a26a7eb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:22.866918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 262/540] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:22.874857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:22.978884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a463-87f2-4d47-a122-6143916de470 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:23.017261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:23.017942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:23.018224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:23.018490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:23.019324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=4920e5f3dcdc4b068f4a0b3a1f9bc03a) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:23.019632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:23.021073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd787-766c-4018-a599-564c97ead59a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:23.027371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 279/541] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:22 2022] GET /identity/v3/role_assignments?user.id=4920e5f3dcdc4b068f4a0b3a1f9bc03a&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:23.454784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daccf-8739-45ae-830f-2c7a981309ce None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:23.455095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daccf-8739-45ae-830f-2c7a981309ce None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:23.455343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daccf-8739-45ae-830f-2c7a981309ce None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:23.456980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 263/542] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:23.462441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:23.462726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:23.463000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:23.483654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:23.484846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:23.568902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 280/543] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:23.613904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daccf-8739-45ae-830f-2c7a981309ce None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:23.747440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daccf-8739-45ae-830f-2c7a981309ce None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:23.803875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:23.804676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:23.804946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:23.805209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:23.824629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:23.840567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:23.841488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:23.842730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 264/544] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:23.849366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:23.951213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0956-c533-43c1-9e41-9b7f394aecb6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:23.989486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:23.990551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:23.991041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:23.991577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:23.992506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:23.993026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:23.994630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:24.009501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 281/545] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:24.015044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.140256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef77a-ac06-4435-ba97-906ecac615e1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:24.172494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:24.173268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.173541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.173836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.185757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:24.187211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-93497893-4791-4a0e-8209-a2a3755aa14a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:24.206473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:24.207382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:24.208658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:24.208658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:24.208658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:24.208658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:24.208658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 265/546] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:24.214112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.364380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d118c-249b-460b-bd75-e6bf74452317 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:24.416882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:24.417565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.417878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.418147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.418870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:24.419169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:24.420545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:24.423020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1f0c-1179-4a93-b690-ff24f1384d11 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.423536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1f0c-1179-4a93-b690-ff24f1384d11 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.424010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1f0c-1179-4a93-b690-ff24f1384d11 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.425821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 266/547] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:24.431453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.431964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.432456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.447548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 282/548] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:24.454419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:24.454548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.456025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:24.526492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 267/549] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:24.550358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.640573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ef4d3-ff38-4d27-887a-426da91d7cbd None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:24.648568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f369a95-b2ca-415f-95f2-0e0dc2a51f34 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:24.682320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:24.683608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.684078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.684537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.700358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:24.708400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:24.709894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:24.710686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:24.713309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 268/550] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:24.719196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.728740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:24.729550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.729862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.730135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.746793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:24.748257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:24.780550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:24.781469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:24.782362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 283/551] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:24.789564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.831209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25326732-279c-4060-911a-b4f204582ab4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:24.892593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:24.893636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:24.894189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:24.894648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:24.895577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:24.897774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:24.902551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:24.916840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 269/552] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:24.930445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:24.959434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a408-d435-49c9-ac80-ff4f6395217c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:24.999752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.000773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.001912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.002536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.004901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:25.005431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.007695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.064097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 284/553] 10.222.0.70 () {56 vars in 1135 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:25.070632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.115806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a183e-5c19-4e7e-900c-d4303b8056a2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.154207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.154920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.155190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.155451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.174080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.175534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:25.193241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:25.194646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:25.195484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:25.195484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:25.195484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:25.195484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:25.199524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 270/554] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:25.200710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.222329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeefdf-d28c-476a-b2ce-88e044a4f49e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.278919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1937d-7568-452e-8640-b1c0b4bebca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.279736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1937d-7568-452e-8640-b1c0b4bebca0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.280009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1937d-7568-452e-8640-b1c0b4bebca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.280277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1937d-7568-452e-8640-b1c0b4bebca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.307893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777558f4-a4bf-438b-8ea7-aecaa0986e4e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.339773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.340433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.340709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.340979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.341690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:25.342017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.343384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a551bc-65f0-4975-871e-87bc73325d97 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.349275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1937d-7568-452e-8640-b1c0b4bebca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.350812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1937d-7568-452e-8640-b1c0b4bebca0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.356071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 271/555] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:25.361468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475745c6-3d3c-48eb-a2cb-80de7d5c047b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.361764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475745c6-3d3c-48eb-a2cb-80de7d5c047b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.362278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475745c6-3d3c-48eb-a2cb-80de7d5c047b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.368380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 272/556] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:25.368380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dac86-5fca-49b3-95ff-27eaa5887856 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.368380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dac86-5fca-49b3-95ff-27eaa5887856 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.368380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dac86-5fca-49b3-95ff-27eaa5887856 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.368380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 273/557] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:25.368723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dac86-5fca-49b3-95ff-27eaa5887856 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.464879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 285/558] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:43:25.466615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.466966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.467304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.477094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dac86-5fca-49b3-95ff-27eaa5887856 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.485362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:25.487037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:25.511252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.512281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.512553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.512818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.519659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.521141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-baa1eca2-8174-4a6c-b537-5fa0c948216c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:25.535364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:25.536270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:25.538306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 274/559] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:25.538863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.538863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.539172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.555485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:25.556664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:25.574053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 286/560] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:25.574053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.620512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 275/561] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:25.621350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.668640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be774c-718c-4c01-b322-f82ae2254d7b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.700964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.701757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.702044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.702310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.711317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ae9e9-c8fb-466b-938a-79857f48ce68 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.711700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.713119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-20acb16f-0394-4b03-925f-2175e42edd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:25.730085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:25.730937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 287/562] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0c4b-5c4a-42ce-b5ae-59a108cf5829 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0c4b-5c4a-42ce-b5ae-59a108cf5829 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf0c4b-5c4a-42ce-b5ae-59a108cf5829 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.736574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 288/563] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:25.737048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf0c4b-5c4a-42ce-b5ae-59a108cf5829 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.744119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.744788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.745064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.745335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.746197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:25.746781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:25.747943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:25.764125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 276/564] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:25.764909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.829574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf0c4b-5c4a-42ce-b5ae-59a108cf5829 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.855282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ad20-4b84-45e4-b5dc-d3ead41e4192 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.861197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.862006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.862279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.862799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.872175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:25.879824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:25.881233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 289/565] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:25.882244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:25.891358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de829e4a-4828-4643-a6c0-9f772c461c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:25.892142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de829e4a-4828-4643-a6c0-9f772c461c73 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.892414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de829e4a-4828-4643-a6c0-9f772c461c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.892678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de829e4a-4828-4643-a6c0-9f772c461c73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.902827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de829e4a-4828-4643-a6c0-9f772c461c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-de829e4a-4828-4643-a6c0-9f772c461c73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:25.910396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:25.911430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 277/566] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:25.913614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:25.914888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:25.914888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:25.930979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:25.932088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:25.973267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f759-45f6-4149-b962-17b368e37f2d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:25.993618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 278/567] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:25.994462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.005992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.006708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.006981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.007247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.007946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.008245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.009607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.020825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 290/568] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.022246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.086471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9e9a-170d-4c43-9a7b-8e2c81f58c7a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.115097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd8147-51b3-44a3-b988-db09801dbd90 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.118224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.119011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.119288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.119559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.129094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.130641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.147005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.147664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:26.147759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:26.148644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:26.149519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:26.149519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:26.149519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:26.149519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:26.149767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.149767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.149895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 279/569] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:26.149961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.149961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.150078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.150673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.161779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 291/570] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.161779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.242604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06fb44-cb97-45a1-9e8b-ed45e2839895 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.252248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322b444-2031-41bc-a828-803a4b18e41a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.274456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.275110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.275384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.275656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.276393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.276695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.278108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.284509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.285274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.285663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 280/571] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.285786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.285916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.286364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.296005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:26.303651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:26.304642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 292/572] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:26.306068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.384655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0df6c9-daf5-42da-ba76-7c9f7cba057d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.400172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e87e9-a3bf-47d7-9da4-a1842dbe5a0f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.416188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.416970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.417240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.417508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.423882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.425310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.434145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.434789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.435062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.435328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.436027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.436323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.437660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:26.438764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:26.439579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:26.440531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 281/573] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:26.441007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.449644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 293/574] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.450457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.536226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cbf39-ff86-405b-a9a9-0d15abcde036 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.542377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75df5-6b8b-47c1-8897-911fe3f38976 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.567530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.568865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.569141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.569411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.574298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.575077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.575350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.575619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.579046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.580498 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.585149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.586612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:26.597126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:26.598023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:26.598986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:26.598986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:26.598986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:26.598986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:26.598986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 282/575] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:26.599256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:26.603252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:26.604290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:26.605338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:26.605338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:26.605338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:26.605338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:26.605338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 294/576] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:26.605338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.696684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2533424-b3b2-41b8-955f-5e6bd174cc69 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.699366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a035-dd8f-443d-aee3-7b4a086cabc6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.727085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.727729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.728008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.728274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.729001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.729298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.730036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.730669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.730779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.730938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.731203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.731963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.732262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.733664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.738427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 283/577] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.739197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.745856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 295/578] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.746739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.831708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c6112-fe10-4b5a-ad50-e3e83f826215 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.841313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd1ea1-4033-41a1-85e1-a6a386aba03c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.869327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.870133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.870405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.870670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.877037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.877149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:26.877838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:26.878112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:26.878376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:26.878492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.879079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:26.879374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:26.881377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:26.891865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 296/579] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:26.892632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:26.893168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:26.894052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:26.895260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 284/580] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:26.895897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:26.985652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a412d7b-7bf6-4d47-92f1-e51f302b5225 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:26.986541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605858cf-889a-422d-90b6-f9a0ba9529e8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.017036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.017819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.017927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.018092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.018359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.018478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.018757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.019029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.019736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:27.020040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.021435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.027880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.029305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.032554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 297/581] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:27.033338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:27.046401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:27.047453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:27.053126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:27.053126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:27.053126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:27.053126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:27.053126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 285/582] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:27.053126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.132607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c4ce3-d676-4b8f-b9a4-56888b300583 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.150389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841ebc7-db0b-42c8-957a-9c8f624784dc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.164085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.164731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.165000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.165265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.166111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=15960410c990447c9773da8ae5be7cb7) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:27.166413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.167834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.173239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 298/583] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/role_assignments?user.id=15960410c990447c9773da8ae5be7cb7&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:27.173839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.189678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.190617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.190905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.191182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.199957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.201450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:27.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:27.218356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 286/584] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:27.219402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.284983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dc192-0969-4aeb-9c2b-a2cfb01ea4e9 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.322125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.322798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.323128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.323466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507c73-2a8b-42df-982b-035079270f32 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.323573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.324311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:27.324625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.326129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.343198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 299/585] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:27.343198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.359090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.359967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.360314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.360591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.369903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.371354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:27.386131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:27.387153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:43:27.388083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:27.390391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 287/586] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:27.391419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.448795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1fb08-d4f5-4d6e-a26e-49aac5c91f73 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.481770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.482437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.482716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.482987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.483715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:27.484022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.485432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.497868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 300/587] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:27.498604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e2484-9f1c-4a26-ac61-b4eec458ea78 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.499247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.534045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.534759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.535040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.535901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.536143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:27.536448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.538003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.558208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 288/588] 10.222.0.70 () {56 vars in 1137 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:27.559020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.602475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68bc6-7ee7-4744-bafa-1c0dfb447000 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.635707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.636640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.636865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.637139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/fc0134f8e7c1401eb79c443f67174a0f/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.652844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=fc0134f8e7c1401eb79c443f67174a0f, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.654516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.662237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8a34-b0d0-41f5-83b2-927d30dd2528 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.668759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 301/589] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:27 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/fc0134f8e7c1401eb79c443f67174a0f/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:27.669604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.708019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.709168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.709596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.710046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.711091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:27.711610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.713236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.733597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 289/590] 10.222.0.70 () {56 vars in 1137 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:27.739565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.781216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c693b-47b9-4d96-9dc3-f9bc7617311f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.818540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.819354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.819634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.819908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.830360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.832488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.847201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311afd9-fb91-41b8-86e7-1ef629848bee None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:27.852871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:27.853934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 16:43:27.854939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:27.858592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 302/591] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:27.858714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.889647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:27.890463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:27.890735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:27.890999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:27.903823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:27.905277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:27.923102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:27.924057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:27.924950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:27.924950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:27.924950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:27.924950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:27.924950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 290/592] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:27.925695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:27.983888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b724fa-fae7-425d-a4e8-d80fe9ae4551 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.026219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3561437-6fdc-4678-8b63-7f61d451dba7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.029464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.030983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.031468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.031942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.044966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.047561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.059875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.060594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.060826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.061101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.061989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:28.062298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.063733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:28.071723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:28.072634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:28.073509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:28.073509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:28.073509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:28.073509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:28.075215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 303/593] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:28.080760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.093569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 291/594] 10.222.0.70 () {56 vars in 1139 bytes} [Mon May 16 16:43:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:28.094548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.196197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4372ef-7082-4735-a980-166c6cf256b0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.204891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57ecc6-37ae-47de-bd66-9869d368dbbb None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.232417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.233088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.233363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.233635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.234706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:28.235048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.237094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.243506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.244427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.244934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.245406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.246393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:28.246704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.248112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.254995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 292/595] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:28.256741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.266431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 304/596] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:28.267664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.391087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c3789-2168-4b9a-8a71-8a1f77e3608d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.395857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac3c3-93e9-400c-a57a-a70e1ec433e7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.438936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.440097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.440612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.441110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.441353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.441919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.442195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.442458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.450905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.453425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.453565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.455024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:28.472002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:28.472973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:28.473903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:28.474994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:28.475777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:28.476682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:28.476682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:28.476682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:28.476682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:28.476682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 293/597] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:28.476682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.480222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 305/598] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:28.486325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.592849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37de1f1-503e-4986-9fa2-c075cee52f12 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.607181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83788bf-4312-4ed7-a0f0-c51bc74af50e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.627261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.628047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.628319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.628584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.635803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.637612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.646072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.647559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.648029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.648486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.649416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:28.649951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.651614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:28.652746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:28.654709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 294/599] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:28.655619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.668845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 306/600] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:28.670054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.752406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865adaaa-27f2-48cd-b380-fb249a4c8f76 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.776984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f645f8-fd85-4041-9be4-11faaeffb5b5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.787253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.787910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.788183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.788741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.789228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:28.789528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.791018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.808101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 295/601] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:28.808101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.822093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.824204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.824685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.825174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.826341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:28.826855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.828480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.841397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 307/602] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:28.842707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.909635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433a73e-14fb-48dd-a15a-638a20b68da7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.943915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.944646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.944920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.945186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:28.948517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc839-816f-41b0-9eeb-e4b7a8870b96 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:28.951896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:28.953377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:28.967539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:28.968495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:28.969399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 296/603] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:28.970412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:28.986249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:28.987368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:28.988081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:28.988511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/c3d39e375e994373b5bd403baa053e45/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.004509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=c3d39e375e994373b5bd403baa053e45, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:29.007071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:29.022278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 308/604] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:28 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/c3d39e375e994373b5bd403baa053e45/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:29.031017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:29.080644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890dd3-ca00-464a-b78d-95c566663161 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:29.117688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:29.118652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:29.118935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:29.119264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/9e3e792f55154143932d62ac460022b1/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.135379 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=9e3e792f55154143932d62ac460022b1, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:29.136868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:29.175793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b00e-bcd5-4d74-91f2-f8241377fcf0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:29.181598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 297/605] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:28 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/9e3e792f55154143932d62ac460022b1/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:29.218638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:29.219720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:29.220204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:29.220677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.221680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:29.222303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:29.224129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda2373-a100-4adb-8ce0-7c03822d182b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:29.242841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 309/606] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:29.249818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:29.390646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1cd2e-113f-4a16-a659-9a3e67d617c5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:29.438558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf59a-88dc-4322-8f05-69fa3d1b5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:29.439481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf59a-88dc-4322-8f05-69fa3d1b5b84 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:29.439749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf59a-88dc-4322-8f05-69fa3d1b5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:29.440010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf59a-88dc-4322-8f05-69fa3d1b5b84 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/4920e5f3dcdc4b068f4a0b3a1f9bc03a/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.455408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cf59a-88dc-4322-8f05-69fa3d1b5b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=4920e5f3dcdc4b068f4a0b3a1f9bc03a, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:29.456897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cf59a-88dc-4322-8f05-69fa3d1b5b84 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:29.472138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 298/607] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:29 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/4920e5f3dcdc4b068f4a0b3a1f9bc03a/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:29.613459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4b23-8add-41cb-ae59-f7a22541eb3f None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:29.613804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4b23-8add-41cb-ae59-f7a22541eb3f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:29.614037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4b23-8add-41cb-ae59-f7a22541eb3f None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.615773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 310/608] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:29.621879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:29.622173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:29.622424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.643106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:29.644229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:29.728627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 299/609] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:29.752994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4b23-8add-41cb-ae59-f7a22541eb3f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:29.882538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4b23-8add-41cb-ae59-f7a22541eb3f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:29.931488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:29.931488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:29.931488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:29.931488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:29.942353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:29.950959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:29.951901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:29.952745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:29.955298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 311/610] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:29.961692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:30.117950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6fcdc-a355-44ac-a47f-65786f3c393a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:30.172492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:30.173625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.174141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.174628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.175581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:30.176103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:30.177703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b361-67a5-4284-82df-ac1dab3ae001 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:30.190587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 300/611] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:30.198879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:30.302031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f93d5-28ab-45b7-9306-d27ef396d2fa None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.303254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f93d5-28ab-45b7-9306-d27ef396d2fa None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.303932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f93d5-28ab-45b7-9306-d27ef396d2fa None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.305783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 301/612] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:30.312016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.312565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.313222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.342514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:30.343692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:30.375216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561420fc-d7c5-405c-ae1a-0f8b106bd7db None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:30.426303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:30.427881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.428381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.428864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.440476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:30.442303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:30.461431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:30.462444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:30.463477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:30.463477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:30.463477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:30.463477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:30.465344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 312/613] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:30.474831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:30.536317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 302/614] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:30.593166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40970bc-84da-44eb-bbe6-b734d37a39c8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:30.612179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:30.649578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:30.650542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.651067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.651499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.652394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:30.654303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:30.655925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:30.680251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 313/615] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:30.686580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:30.796485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddc53f-2b51-4d15-91c1-4d712aaa7299 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:30.855768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aecfc-58aa-4065-8416-4410c417e799 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:30.871676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:30.872536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.872815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.873085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.895896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:30.914117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:30.915133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:30.915970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:30.916625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 303/616] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:30.927862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:30.928925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:30.929423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:30.929942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] PATH_INFO: `/v3/users/swift` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:30.930398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:30.943888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:30.945343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:30.978182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:30.979182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:30.980120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:30.985547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 314/617] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:30.986390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.107700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81691c-f130-4d8a-acf0-466411dbcbde None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.149390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.150091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.150371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.150643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.151487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:31.151794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.153235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.159837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de373-a674-4226-906c-775e6eaf36bc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.181497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 315/618] 10.222.0.70 () {56 vars in 1135 bytes} [Mon May 16 16:43:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:31.186873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.217283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.219586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.220737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.221383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.223798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:31.225162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.227551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.243248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 304/619] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:31.249025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.356661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b201f-65ac-4549-9e6f-526bf33740a6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.403050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.404633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.416744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.417354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.429814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.431739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:31.451121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:31.452039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:31.452925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:31.452925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:31.452925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:31.452925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:31.455606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 316/620] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:31.463677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.480768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd474-ae19-4dca-8ad2-b74e543b990d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.547494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.549377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.550208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.551113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.567852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.570103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f9a115cb-77ec-4bab-aa78-e7268f5a01d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:31.603110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:31.604079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:31.604962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:31.604962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:31.604962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:31.604962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:31.608790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 305/621] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:31.610129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca6a5f-e37c-4881-98a8-4eb466715a81 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.610408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca6a5f-e37c-4881-98a8-4eb466715a81 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.610676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca6a5f-e37c-4881-98a8-4eb466715a81 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.617081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 306/622] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:31.617868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca6a5f-e37c-4881-98a8-4eb466715a81 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.621362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b497f39-5513-49bd-9fab-36fdb832f225 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.659024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.659651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.659931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.660207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.660930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:31.661235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.663244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816f5d-7859-43f7-9e95-0f9275306b00 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.682412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 317/623] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:31.682412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.682412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.682412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.699591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:31.701065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:31.736282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca6a5f-e37c-4881-98a8-4eb466715a81 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.779634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.779867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 318/624] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:31.781338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.786489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.786489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.790733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.790733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:31.790733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.795776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.813802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 307/625] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:31.815573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.918456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578052f-75da-428e-ab90-dbca13a8dff9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.940608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e96f-93e4-4ec2-98e8-5a995da16ce2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:31.954643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.955745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.956253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.956741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.964365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:31.965854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:31.977391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b87d3-4bcc-490e-a6d4-e8e73e666103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:31.978215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b87d3-4bcc-490e-a6d4-e8e73e666103 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:31.978500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b87d3-4bcc-490e-a6d4-e8e73e666103 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:31.978764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b87d3-4bcc-490e-a6d4-e8e73e666103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:31.979954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:31.980794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:31.981670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:31.985778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 319/626] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:31.986786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:31.989251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b87d3-4bcc-490e-a6d4-e8e73e666103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-644b87d3-4bcc-490e-a6d4-e8e73e666103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:31.997107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:31.998093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 308/627] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:32.000086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be52b4-69da-43e5-bbdb-ddf67abc212d None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.000849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be52b4-69da-43e5-bbdb-ddf67abc212d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.000849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be52b4-69da-43e5-bbdb-ddf67abc212d None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.005670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 309/628] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:32.005670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be52b4-69da-43e5-bbdb-ddf67abc212d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.091895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0ed50-0382-45d9-bc71-6f51d800efa9 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.108615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be52b4-69da-43e5-bbdb-ddf67abc212d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.132400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.133902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.134649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.135084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.140963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.141617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.141926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.142197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.142974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:32.143281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.144392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.144726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.146888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.156877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 310/629] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:32.158001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-694f963d-2e99-487d-a095-62a102e1e75b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:32.167984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:32.168992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 320/630] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:43:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.170767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.171533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.187131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:32.188304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:32.260774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40ad1f-fc10-40d3-9e1f-6073da14a15c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.266078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 321/631] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:32.266938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.295230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.295898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.296178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.296450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.297190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:32.297491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.298885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.306739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 311/632] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:32.307338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.363685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e747d-199d-4d0f-9aac-8b22f21da4f3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.395237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03611124-03fd-4363-b258-2f63cdab6da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.396682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03611124-03fd-4363-b258-2f63cdab6da5 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.396962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03611124-03fd-4363-b258-2f63cdab6da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.397229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03611124-03fd-4363-b258-2f63cdab6da5 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/15960410c990447c9773da8ae5be7cb7/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.399059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1873-b666-400f-b0ab-5a102c96b9e7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.413561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03611124-03fd-4363-b258-2f63cdab6da5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=15960410c990447c9773da8ae5be7cb7, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.415022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03611124-03fd-4363-b258-2f63cdab6da5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.426567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 322/633] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:32 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/15960410c990447c9773da8ae5be7cb7/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:32.427778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4919-71ef-4621-826c-2092b05456f9 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.428066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4919-71ef-4621-826c-2092b05456f9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.428334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf4919-71ef-4621-826c-2092b05456f9 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.429787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 323/634] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:32.432697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.433384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.433877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.434000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.434535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf4919-71ef-4621-826c-2092b05456f9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.434830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:32.435140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.436605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.461240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 312/635] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:32.461240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.558008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf4919-71ef-4621-826c-2092b05456f9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.570482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f218e-30d7-4292-b045-7474499680e0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.596477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9bcb5-e9ec-4f49-8941-23e72680c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.597288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9bcb5-e9ec-4f49-8941-23e72680c601 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.597670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9bcb5-e9ec-4f49-8941-23e72680c601 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.597881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9bcb5-e9ec-4f49-8941-23e72680c601 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.606194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.606996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.607273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.607547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.609767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9bcb5-e9ec-4f49-8941-23e72680c601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-19d9bcb5-e9ec-4f49-8941-23e72680c601 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:32.618937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:32.620076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:32.620911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:32.621547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.622497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.623560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 324/636] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:32.625047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.625531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.626037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:32.641182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:32.642180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:32.643501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:32.643501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:32.643501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:32.643501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:32.643501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 313/637] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:32.643776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:32.643856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.644368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:32.711441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 325/638] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:32.712231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.755290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526154d-0aa7-41f8-8027-2f19605bba03 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.788413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.789084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.789361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.789637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.806990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715b6c-f817-4423-b549-6ae3ebe3f0a8 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.850018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.850761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:32.851051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:32.851326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:32.852764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:32.853326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.856220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.862725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:32.864253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:32.869858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 326/639] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:32.869858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.966219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b9906-68c4-4c61-9a55-765e117b9d32 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:32.970062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 314/640] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:32.971434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:32.999124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:32.999784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.000060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.000327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.001033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:33.001340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.002726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.014972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 327/641] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:33.015854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.071611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36da1-3f1f-4770-9cc2-ef91daf5523a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.105231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.105858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.106139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.106412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.111691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3df158-46bb-40f3-9329-8fa5073f439b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.116612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:33.124154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.125083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:33.125988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 315/642] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.126671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.153403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.154226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.154556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.154827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.165090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.166806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:33.187411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.188516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.194689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:33.194689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:33.194689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:33.194689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:33.194689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 328/643] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.194689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.236416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec744b-2ade-4d1d-a73d-a83b714d3e99 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.268559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.269340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.269778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.269885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.280884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.282414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.290797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0657-51d2-4947-b383-e858a320cf82 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:33.299979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.300907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.301911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:33.301911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:33.301911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:33.301911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:33.301911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 316/644] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.303161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.329460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.330271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.330546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.330815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.337977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.339427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:33.352916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.353864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:33.354802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 329/645] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.355393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.403240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8620-9610-41ab-9b9a-fdbb72c06a1a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.438387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.439048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.439326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.439597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.440343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:33.440641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.442032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.450552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 317/646] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:33.451134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.462897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48db66-6905-4562-b81d-bbf811a15740 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.498750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.498750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.498750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.498750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.499192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:33.499378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.501022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.519210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 330/647] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:33.524849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.553824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf825f51-75c5-4d6d-8a2a-7c0817b149b1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.587209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.587953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.588301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.588646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.589443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:33.589849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.591320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.604689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 318/648] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:33.605600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.625600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84a5e3-d416-454a-9d0a-cae772dd3b9c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.658293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.658949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.659224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.659485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.660312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:33.660605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.662605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.680129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 331/649] 10.222.0.70 () {56 vars in 1137 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:33.681384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.706329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7329b10-3db1-4aec-a198-da11f4491b51 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.738874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.739661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.739967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.740236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.749927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.751317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:33.769893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.771714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.772759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:33.772759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:33.772759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:33.772759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:33.777164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 319/650] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.778046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.778596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f77164-7ecd-4964-a56d-8c4387d95b94 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.810678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.811562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.811839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.812102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] PATH_INFO: `/v3/users/glance` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.820331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.821887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:33.836498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.837615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 332/651] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.838599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.880846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b32b9-0ad4-4773-bcc8-ceb5168ba818 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.912857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.913638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.913937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.914196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:33.921850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:33.923408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:33.936512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa62974-a28d-470c-a366-84b904afe0db None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:33.938347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:33.939395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:33.940479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:33.946923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 320/652] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:33.946923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:33.970220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:33.970872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:33.971153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:33.971429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.036875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.037689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d3392-723f-4191-8acf-0f7796059b3c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.038316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.070039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.070694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.070966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.071234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.071938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:34.072237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.073585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.088687 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 321/653] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:34.088687 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.137573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 333/654] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:34.138864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.186718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149f59-1507-43d2-87e6-432a852c2b2b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.220170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.220836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.221114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.221386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.222256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:34.222562 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.224013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.231666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9469e-bb1a-4450-8623-f4dd8f76e5d8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.241568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 322/655] 10.222.0.70 () {56 vars in 1137 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:34.243457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.270509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.271198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.271478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.271750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.272541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:34.272849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.274311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.286413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 334/656] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:34.287418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.344065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905df34-6955-4950-9f05-1140307783b6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.386222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960eff8-1d6e-4892-b4f6-87b5fbf6b5bb None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.425726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.426568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.426845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.427115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.439042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.440534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:34.459006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:34.459957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:34.460867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:34.460867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:34.460867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:34.460867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:34.460867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 335/657] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:34.461616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.502383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.503180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.503456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.503730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.511819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.513308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:34.528731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:34.529900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 323/658] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:34.530878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.569715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350cab63-a317-4b83-8a1f-9d806fabc9c5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.602668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.603308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.603581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.603851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.628027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4d87-ab74-47cd-9a22-1345222b46ce None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.659459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.660108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.660383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.660656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.661474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=fc0134f8e7c1401eb79c443f67174a0f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:34.662344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.663769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.669433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 324/659] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/role_assignments?user.id=fc0134f8e7c1401eb79c443f67174a0f&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:34.670265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.679201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.681636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.785589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52e30b-7db6-4235-88da-9550921fb254 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.805146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 336/660] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:34.806163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.822090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.822678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.822953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.823578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.823941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:34.824239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.825705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d27f9-9256-4ed7-967b-9ae13e5dbb8f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.838165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 325/661] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:34.839534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddbb99-b819-4e51-96c3-3250f978161b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.839815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddbb99-b819-4e51-96c3-3250f978161b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.840083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddbb99-b819-4e51-96c3-3250f978161b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.845429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 326/662] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:34.845429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddbb99-b819-4e51-96c3-3250f978161b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.924431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993cd3b-ca78-4b57-a14b-895484180b11 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.959104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.959772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.960047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.960316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:34.961150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:34.961452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:34.962060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddbb99-b819-4e51-96c3-3250f978161b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:34.963035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:34.984528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 337/663] 10.222.0.70 () {56 vars in 1139 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:34.984528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:34.994945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:34.995741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:34.996019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:34.996284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.006633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.008075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e7b70006-1574-45fa-b304-31a39b1e7b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:35.024951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:35.025893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:35.026799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:35.026799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:35.026799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:35.026799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:35.026799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 327/664] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:35.027783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.028079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.028395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.044723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:35.045973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:35.081992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c234d-f716-4605-9576-ebf4af16b439 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.117761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 328/665] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:35.117761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.118032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.118032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.118032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.118032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.124444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.125928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:35.139968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:35.140907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:35.141847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 338/666] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:35.142356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.214548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0a07-1756-4334-979d-f83e81e6f307 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.241147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868331c-92df-483d-96d7-f3ffd18062ec None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.248520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.249170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.249452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.249726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.274841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.275499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.275778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.276044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.276752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:35.277055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.278451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.294324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 339/667] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:35.294324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.320736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.322223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.393085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc22e3-37b9-4772-baf9-1ae424b90bc5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.425841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 329/668] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:35.425841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.437510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.438335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.438616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.438907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.449289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:35.456933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:35.457917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 340/669] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:35.464541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.517073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8535f8-3edb-46ff-b365-ab8afd823e39 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.550372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.551019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.551291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.551555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.552821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:35.553119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.554561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.562690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567d98-7396-4cdc-906a-0ff05b29a081 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.567401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 330/670] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:35.569104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.598272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.599188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.599555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.599898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.606412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.607856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:35.622339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:35.623211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:35.624113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 341/671] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:35.625101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.671160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5e93-9fa5-45d0-a886-86336f084620 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.703526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.704335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.704587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.704856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.714850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.716286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.717965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85123fc5-2758-4ce3-a822-5bf1f1864a17 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:35.732342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:35.733270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:35.734571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:35.734571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:35.734571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:35.734571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:35.734571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 331/672] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:35.734571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.755010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.756215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.756495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.756760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.757494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:35.757821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.759184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.766728 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 342/673] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:35.771167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.839343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac46f72-687e-498b-bbbe-62630bb5caf6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.863761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989bf29-c636-4119-9731-a615addfc476 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:35.873807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.874463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.874741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.875027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.875835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=c3d39e375e994373b5bd403baa053e45) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:35.876142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.877650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.884005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 332/674] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/role_assignments?user.id=c3d39e375e994373b5bd403baa053e45&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:35.894901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:35.898018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:35.898928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:35.899456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:35.899957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:35.900977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:35.901499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:35.903402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:35.919395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 343/675] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:35.920604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.010343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee8901-4f32-4795-819e-959f1e78ad5b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.030418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90713-be0d-44cd-a09f-1951f7b220a8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.046345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.047023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.047673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.047673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.048359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:36.048812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.050312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.063775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 333/676] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:36.064648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.070441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.071524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.072030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.072505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.083271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.085037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:36.104943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:36.106179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:36.107092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:36.107092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:36.107092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:36.107092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:36.107092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 344/677] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:36.107393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.174359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88996f-8f93-49af-8269-e516992e9a6c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.208226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.208911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.209242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.209523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.210434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=9e3e792f55154143932d62ac460022b1) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:36.210743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.212231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.218131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f19de-bc9d-43c1-87ec-934c917ca1b6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.218370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 334/678] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/role_assignments?user.id=9e3e792f55154143932d62ac460022b1&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:36.219171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.253953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.254747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.255020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.255316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.262450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.263875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:36.282489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:36.283469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:36.284363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:36.288906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 345/679] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:36.290482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.397428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633a24b-5a5c-46be-bbaa-87a8f3a4a0b3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.444134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.444807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.445083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.445357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.446185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:36.446489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.447964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.463179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a06e05-8e45-4f9e-a6d8-f80a23bb6ab6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.465844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 346/680] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:36.467488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.511343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.512546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.513087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.513561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.514531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:36.515050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.516717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.535499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 335/681] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:36.541783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.663705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6eb15-7ebe-42a8-83c7-1fbfe1318b5a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.699957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.700715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.700988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.701252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.709352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.710850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.721998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b345f-40b9-4b1f-84d0-24ab3531751d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:36.725484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:36.726483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:36.727434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 336/682] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:36.735559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:36.766398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.768096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.768736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.769494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.770772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=4920e5f3dcdc4b068f4a0b3a1f9bc03a) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:36.771797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.774140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.780617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 347/683] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/role_assignments?user.id=4920e5f3dcdc4b068f4a0b3a1f9bc03a&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:36.851023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf2679-321d-4755-8f5a-5e11ef0547d8 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:36.897965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:36.898656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:36.898935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:36.899208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:36.900123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:36.900437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:36.901929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d67de-f034-4166-898a-da0a7f8c7dc2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:36.922365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 337/684] 10.222.0.70 () {56 vars in 1135 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:36.928055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.034048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242443ad-2167-479b-b8e8-0e41c5051c6d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:37.059393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7392795-0ae0-4af5-8842-e0f09cad9ec3 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.059722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7392795-0ae0-4af5-8842-e0f09cad9ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.059943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7392795-0ae0-4af5-8842-e0f09cad9ec3 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.061423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 338/685] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:37.067627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.068731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.069234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.072349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:37.073175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.073599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.074045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.087181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:37.088400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:37.143066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:37.144827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:37.158728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 339/686] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:37.182899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.248362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 348/687] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:37.254030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.285663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686c128-6e33-4dc7-a3d9-42213b867d9d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:37.321529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:37.322494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.322869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.323236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.334959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:37.342703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:37.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:37.344508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:37.349887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 340/688] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:37.350615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.357994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f03af-3523-49c9-a0be-e92b50a8c2f5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:37.401587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:37.402425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.402683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.402950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.433915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:37.437028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:37.473602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:37.475370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:37.476271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:37.476271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:37.476271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:37.476271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:37.482086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 349/689] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:37.483040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.489349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2c54-419e-49e4-ae7c-3ba2d5ef7fe5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:37.533927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:37.534843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.535291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.535778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.538400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:37.540225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:37.541778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:37.562411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 341/690] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:37.570110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.697187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b260-78a7-4f54-80ed-f12fc12bdb8d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:37.719882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c28e9a-88c0-411f-bdb4-8fae971acfc2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:37.736195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:37.737625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.738104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.738869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.754067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:37.756095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:37.773572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:37.774676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:37.775744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:37.775744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:37.775744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:37.775744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:37.777580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 342/691] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:37.780820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:37.782082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:37.783035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.783815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:37.786118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:37.787530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:37.790074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:37.795346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:37.818489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 350/692] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:37.823849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:37.965582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d97861-f00b-4aaa-9397-6799b4907e8a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.016567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4279f8-3bcd-4ffe-9a8d-8b2f2960dbb2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.028263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.029115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.029394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.029664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.030747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:38.031062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.032720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.055531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 343/693] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:38.062680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.079481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.080354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.080570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.080846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.098900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.100972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:38.134048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:38.135018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:38.135907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 351/694] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:38.141246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.170306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eab0ac-93ad-4eac-9168-d1d0fd9867ec None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.210499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.211295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.211567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.211840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.226478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.227925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:38.247030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:38.247992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:38.248931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 344/695] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:38.256598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.338703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e1bb-23c0-49c8-94e1-b05314fa71ef None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.401071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.401762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.402047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.402321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.403110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:38.403416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.404855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.417013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 352/696] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:38.422733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.453324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98231fc4-9817-4cc9-8ff3-0d96bd19ce60 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.496748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e032565-aef5-4351-8284-73119043a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.497419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e032565-aef5-4351-8284-73119043a157 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.497691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e032565-aef5-4351-8284-73119043a157 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.497989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e032565-aef5-4351-8284-73119043a157 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.498834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e032565-aef5-4351-8284-73119043a157 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:38.499140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e032565-aef5-4351-8284-73119043a157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.500574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e032565-aef5-4351-8284-73119043a157 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.539459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 345/697] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:38.544758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e032565-aef5-4351-8284-73119043a157 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.566990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ddcd7-8929-495e-afe0-ef5888406061 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.607593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.608162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.608434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.608701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.609996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=15960410c990447c9773da8ae5be7cb7) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:38.610306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.612045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b207e-f268-44ca-b10a-aac5a26c7443 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.621105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 353/698] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/role_assignments?user.id=15960410c990447c9773da8ae5be7cb7&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:38.622479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983701e-acc6-44d7-9c29-d62c46cfeb75 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.622762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983701e-acc6-44d7-9c29-d62c46cfeb75 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.623030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983701e-acc6-44d7-9c29-d62c46cfeb75 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.625785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 354/699] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:38.636850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.636850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.636850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.667145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:38.668339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:38.717774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e032565-aef5-4351-8284-73119043a157 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.762094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.768730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.768730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.768730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.769034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 355/700] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:38.803546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.855691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.857165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:38.935043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c19818-e0b4-4600-aa64-43df3b704ae3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:38.967442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 346/701] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 16 16:43:38.972529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:38.980430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:38.981128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:38.981401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:38.981965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:38.982657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:38.984040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:39.003861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:39.004977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:39.005910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:39.006706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 356/702] 10.222.0.70 () {56 vars in 1129 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:39.013411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.085179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55537f-2497-45c1-b9e8-f60270aade4c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.122792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.123686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.124036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.124310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.133835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b03a5-831b-4262-b68a-a0c8e713e9d8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.135122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.136614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:39.156138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:39.159222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:39.160102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:39.160102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:39.160102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:39.160102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:39.160102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 347/703] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:39.164437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.180108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.180783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.181061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.181332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.182130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:39.182486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.184042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.189945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 357/704] 10.222.0.70 () {56 vars in 1124 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:39.195871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.300674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f1a04-c18a-4847-8add-ed8e3614c41a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.347401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c96e9-c964-48ae-b53e-63c95d345dfa None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.351264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.352194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.352696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.353166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.354120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:39.354625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.356191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bce7da-e478-4776-b2a7-8c1fb3822d71 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.369634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 348/705] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:39.371326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940b449-64b1-4193-92fd-491bb6198ee3 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.371810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940b449-64b1-4193-92fd-491bb6198ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.372291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940b449-64b1-4193-92fd-491bb6198ee3 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.377820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 349/706] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:39.378702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940b449-64b1-4193-92fd-491bb6198ee3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.384435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675177b-663e-47b7-a450-87793658b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.384677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675177b-663e-47b7-a450-87793658b982 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.384959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675177b-663e-47b7-a450-87793658b982 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.385230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675177b-663e-47b7-a450-87793658b982 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.386003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675177b-663e-47b7-a450-87793658b982 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:39.386315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675177b-663e-47b7-a450-87793658b982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.387683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675177b-663e-47b7-a450-87793658b982 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.393661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 358/707] 10.222.0.70 () {56 vars in 1124 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:39.394867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.395122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.395396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.438996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:39.440525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:39.505265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940b449-64b1-4193-92fd-491bb6198ee3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.544947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.546052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.546483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.546923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.554665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.556400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:39.571078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:39.572198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:39.573291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:39.575458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 350/708] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:39.583035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.622106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 359/709] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:39.645000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.744948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128c440-790f-4038-b90c-7ba62be77923 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.764611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b0605-685c-4d5c-82a3-d0c6b4f2daea None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.782507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.783527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.784027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.784511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.785492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:39.786026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.788211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d966-f09e-44fc-b8b2-9231432356de None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.800890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 351/710] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:39.803308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb005e-9b30-419f-a174-e0f68831618e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.803796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb005e-9b30-419f-a174-e0f68831618e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.804366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb005e-9b30-419f-a174-e0f68831618e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.804806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.805688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.805989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.806258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.807401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 352/711] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:39.808307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb005e-9b30-419f-a174-e0f68831618e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.818433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.820281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-f3835b2d-36e0-40fc-97cf-e7115af15b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:39.843264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:39.844236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:39.845136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:39.845136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:39.845136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:39.845136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:39.849813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 360/712] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:39.851559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.852092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.852559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.870999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:39.872532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:39.933051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb005e-9b30-419f-a174-e0f68831618e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:39.949287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 361/713] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:39.950628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:39.976085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:39.976737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:39.977013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:39.977281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:39.978288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=fc0134f8e7c1401eb79c443f67174a0f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:39.978593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:39.980521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:39.988430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 353/714] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/role_assignments?user.id=fc0134f8e7c1401eb79c443f67174a0f&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:39.989314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:40.061389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db8114-e164-4337-96f9-636115320ae1 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:40.102708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:40.103814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:40.104363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:40.104835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:40.105795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:40.106331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:40.107955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:40.120998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 362/715] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:40.129761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89465e3-b4a5-4e33-8215-4ffb11ebd647 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:40.139827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:40.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:40.165898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:40.166176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:40.166443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] PATH_INFO: `/v3/services/network` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:40.167109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:40.169178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:40.186054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:40.187152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:40.187981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 354/716] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:39 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:40.194818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:40.325542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd4b2-4721-4dfa-ae95-0df8a001d710 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:40.386309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ccb86-a662-49db-b23f-a893c733b6cb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:40.396402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:40.397087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:40.397361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:40.397632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:40.398369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:40.399828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:40.454138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 363/717] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:43:40 2022] POST /identity/v3/users => generated 254 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:43:40.462265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:40.462929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:40.463206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:40.463478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:40.464188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] RBAC: Adding query filter params (name=network) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:40.464502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:40.465895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d2d8-8afa-47d3-98dd-bd0332b7166b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:40.474674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 355/718] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:43:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:40.479872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:40.593702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a1831-7218-4e30-b2f5-c9a58ba5b5f5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:40.631833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:40.632516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:40.632790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:40.633058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:40.633790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] RBAC: Adding query filter params (type=network) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:40.634095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:40.635489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9b7f9-62c9-4a36-bd33-54942442157a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:40.641084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 364/719] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:43:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:41.567082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b2d5e-46da-4c9b-b3d2-1d7795332c3f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:41.567670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b2d5e-46da-4c9b-b3d2-1d7795332c3f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:41.567670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b2d5e-46da-4c9b-b3d2-1d7795332c3f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:41.569534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 356/720] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:41.575042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:41.575498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:41.575578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:41.602744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:41.603917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:41.686320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 365/721] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:41.709810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b2d5e-46da-4c9b-b3d2-1d7795332c3f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:41.844210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b2d5e-46da-4c9b-b3d2-1d7795332c3f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:41.880829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:41.882019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:41.882518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:41.882979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:41.893526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:41.901366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:41.902420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:41.903254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:41.905998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 357/722] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:41.913761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.061007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc7a15-cc12-4d24-8a31-c4837672b3e9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:42.110446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:42.111118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.111395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.111662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.112658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:42.112955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:42.114339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76584a-7beb-4b7d-af17-ba67bc599716 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:42.123584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 366/723] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:42.128798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.138150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24eb9-5b79-4062-9896-36a2c5c03667 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.138420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24eb9-5b79-4062-9896-36a2c5c03667 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.138699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd24eb9-5b79-4062-9896-36a2c5c03667 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.140260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 367/724] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:42.145318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.145595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.145946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.175028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:42.176247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:42.242150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05480876-cf54-4d07-b94e-a4aa95e5abdf None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:42.280855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:42.282047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.282622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.283120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.295302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:42.297053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:42.316114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:42.317102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:42.318137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:42.318137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:42.318137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:42.318137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:42.321306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 358/725] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:42.326457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.326961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 368/726] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 16 16:43:42.375587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.430325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea1785-a1c9-4ba2-9487-3dab5d725645 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:42.463844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:42.464883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.465368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.465899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.466854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:42.467362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:42.468940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:42.481933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 359/727] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:42.488974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.613067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa0b36-cf0c-470e-8cae-e922e4bb993f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:42.633386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c60af-eb5d-4821-9ae3-fc7de851cf02 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:42.648393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:42.649497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.650034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.650529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.658043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:42.659736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:42.675293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:42.676254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:42.677220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:42.681035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 360/728] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:42.687289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.710629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5959c-e3c4-4bfc-9893-a2e6530c3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:42.711639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5959c-e3c4-4bfc-9893-a2e6530c3f9d None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.712151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5959c-e3c4-4bfc-9893-a2e6530c3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.712626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5959c-e3c4-4bfc-9893-a2e6530c3f9d None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.713562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5959c-e3c4-4bfc-9893-a2e6530c3f9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:42.715262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5959c-e3c4-4bfc-9893-a2e6530c3f9d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:42.734056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 369/729] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:43:42 2022] POST /identity/v3/services => generated 251 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:42.736239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb9b5-8432-444d-b192-14b72dcb21e0 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.737108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb9b5-8432-444d-b192-14b72dcb21e0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.737919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdb9b5-8432-444d-b192-14b72dcb21e0 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.741120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 370/730] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:42.747687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.748812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.749503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.771801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:42.773851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:42.813374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847929b-f4cd-4db3-b9dc-c902255cbb4d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:42.895285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 371/731] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:42.903963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:42.904615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:42.904888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:42.905158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:42.906048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:42.906354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:42.907820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:42.934149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 361/732] 10.222.0.70 () {56 vars in 1135 bytes} [Mon May 16 16:43:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:42.939468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:42.964830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.075584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f0c48-c59d-418d-b0c8-337aeeef29e1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.076319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6a65-1338-45f5-8a84-ddc8e2c2eac2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.117603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.118430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.118707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.118972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.127295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512d6f5-fcd4-4516-bc40-be595e1e8e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.128126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d6f5-fcd4-4516-bc40-be595e1e8e80 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.128687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d6f5-fcd4-4516-bc40-be595e1e8e80 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.128952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d6f5-fcd4-4516-bc40-be595e1e8e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.130982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:43.140432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:43.141387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:43.142334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:43.142961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 362/733] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:43.148653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.260965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa21df2-245c-4adc-9f5a-58cb01d84115 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.295376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512d6f5-fcd4-4516-bc40-be595e1e8e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.296923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512d6f5-fcd4-4516-bc40-be595e1e8e80 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.298243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.299319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.299796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.300267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.301198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:43.301724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.303363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.313607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 363/734] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:43.320040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.433238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fc98f-ce6b-4c79-9c08-c1f97ab5a250 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.449892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 372/735] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 16 16:43:43.451852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574ae6-ff4f-4643-96de-25de37221d5a None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.452137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574ae6-ff4f-4643-96de-25de37221d5a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.452412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c574ae6-ff4f-4643-96de-25de37221d5a None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.454050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 373/736] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:43.457093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c574ae6-ff4f-4643-96de-25de37221d5a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.475188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.476322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.476699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.477287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.491170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.493073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-432e677b-1173-4f15-ae60-3a48d89ee0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:43.514957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:43.516937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:43.518924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:43.518924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:43.518924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:43.518924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:43.523089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 364/737] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:43.523412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.523693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.523963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.544554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:43.545726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:43.577689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c574ae6-ff4f-4643-96de-25de37221d5a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.611882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.613034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.613388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.613732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.616893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 365/738] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:43.617760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.624575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.626150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:43.647454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:43.650010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:43.652153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:43.652153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:43.652153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:43.652153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:43.658022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 374/739] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:43.658022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.718185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08866825-3f8c-4eae-9645-c967ba57a0ff None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.751105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.751766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.752039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.752307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.752744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75460557-f369-420a-9d65-e2af0e9c17ce None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.753021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:43.753332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.754748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.771452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 366/740] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:43.771452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.791573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.792229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.792501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.792768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.793484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:43.793796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.795191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba607a41-9013-44ed-9079-5cc5f1cffe69 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.807492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 375/741] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:43.808826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641351-0273-43e4-abf2-9278d2ce84d6 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.809111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641351-0273-43e4-abf2-9278d2ce84d6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.809387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641351-0273-43e4-abf2-9278d2ce84d6 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.810918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 376/742] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:43.815393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641351-0273-43e4-abf2-9278d2ce84d6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.870810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c8b01-30ee-471a-9f95-393e497dbae9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.903273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.904054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.904328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.904596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.914415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641351-0273-43e4-abf2-9278d2ce84d6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:43.914551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:43.922018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:43.922954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 367/743] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:43.929402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:43.959031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:43.959819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.960098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.960366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:43.967635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:43.969141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-8b9018f0-e5df-4007-bd9d-d4dd5c494e04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:43.984012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:43.984966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:43.986101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:43.990608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 377/744] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:43.991690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:43.991967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:43.992235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.008120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:44.009286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:44.037924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2bc5c-1a5f-472e-a5bb-5f72d5c0647a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.071185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.071972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.072248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.072522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.081964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 378/745] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 16 16:43:44.081964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.091020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.092520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:44.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:44.109325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 368/746] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:44.110612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.183010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a4b0-452b-4660-9326-518b3116d87d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.213416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175fa0-8190-4799-ab22-bd75c4e9b662 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.218350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.219018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.219350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.219570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.220317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:44.220620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.222023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.230348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 379/747] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:44.231143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.252687 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.253606 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.254067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.254479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.255480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:44.255962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.257553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.275183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 369/748] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:44.276174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.332719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f4c9d-f792-47be-86a8-88f0d3ae7052 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.368946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.369611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.369921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.370196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.370921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.371263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4b890-bed9-4bc0-b051-6b56f7e291e4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.372276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.393772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 380/749] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:43:44 2022] POST /identity/v3/services => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:44.393772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.438939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.439665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.439943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.440212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.441057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:44.441400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.443471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.458442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 370/750] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:44.459608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.512617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fb40-62cb-4657-b6b6-076274c2d274 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.547401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.548207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.548471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.548744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.561104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.562641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:44.580478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:44.581465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:44.582402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:44.582402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:44.582402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:44.582402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:44.586973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 381/751] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:44.587996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.597385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aa012-bf95-4071-89df-134e95ff4555 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.633786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.634591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.634863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.635125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.647409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.648876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:44.667131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:44.668078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:44.669439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:44.669439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:44.669439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:44.669439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:44.669439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 371/752] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:44.669439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.698828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9b5e3-c9c9-4dec-ab44-68ab70b05053 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.734353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.735399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.735886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.736361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.737667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=15960410c990447c9773da8ae5be7cb7) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:44.738220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.739898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.746291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 382/753] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/role_assignments?user.id=15960410c990447c9773da8ae5be7cb7&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:44.747369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.822896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e4c1a-eda7-40f3-a973-60273878e65b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.918738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5cc0-6f90-4acc-9772-a23f80ccc2d3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:44.926475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.927223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.928007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.928007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.928492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:44.928799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.930261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.957794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:44.958935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:44.959208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:44.959471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:44.960185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:44.960482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:44.962583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:44.963930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 372/754] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:44.969417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:44.977852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 383/755] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:44.984750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.097494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e2088-7103-4df9-9c37-39b8b1e8a2a3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.138799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.138799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.138799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.138799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.146665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.148747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:45.163684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:45.164748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:45.165849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:45.168043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 384/756] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:45.175970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.196912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004addf3-d586-42f4-82cd-04e31dee7b8d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.259100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.260184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.262135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.262556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.272390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.273869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e01b593b-6876-4c0f-9286-0199ff577279 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:45.288864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:45.289874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:45.290810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 373/757] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:43:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:45.296859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cce060-b713-4f22-8a2d-f5ab116b2b92 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.297240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cce060-b713-4f22-8a2d-f5ab116b2b92 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.297517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cce060-b713-4f22-8a2d-f5ab116b2b92 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.303571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 374/758] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:45.303571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cce060-b713-4f22-8a2d-f5ab116b2b92 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.335399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f71ca-14b2-45c0-aec3-9d2bfd7f5fc6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.372593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.373555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.374074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.374544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.375516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:45.376019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.377670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02416d-a053-40ce-9069-a3d31a1a2f22 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.395743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 385/759] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:45.397363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.397896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.398388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.415145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cce060-b713-4f22-8a2d-f5ab116b2b92 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.417538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:45.418951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:45.459019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.459689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.459975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.460227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.461470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:45.461814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.463584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.490068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 375/760] 10.222.0.70 () {56 vars in 1149 bytes} [Mon May 16 16:43:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:45.490911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.498025 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 386/761] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:45.499162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.598885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97b3d-f80c-4408-a12b-4fd3f81feb86 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.628513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dff3e7-bd56-4c6b-b4cf-6779ef97e095 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.636324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.638028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.638510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.638996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/fc0134f8e7c1401eb79c443f67174a0f/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.641211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=fc0134f8e7c1401eb79c443f67174a0f, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.643070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.669787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 376/762] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:45 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/fc0134f8e7c1401eb79c443f67174a0f/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:45.669787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.670073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.670073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.670073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.672239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.807917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.809394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.870744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6184224-582c-4c59-b38c-184b54b04d11 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:45.929560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:45.931090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:45.931363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:45.931628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:45.932277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:45.933705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:45.949689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 387/763] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:45.951544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:45.952440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:45.953268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:45.955028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:45.956906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 377/764] 10.222.0.70 () {56 vars in 1129 bytes} [Mon May 16 16:43:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:45.962999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.070835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0967d-1100-4fa3-93a8-2b6741021c7b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.071818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771aeef-260d-4add-a457-78190b9b1796 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.105294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.106110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.106387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.106656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.107273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.108206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.108698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.109166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.110229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:46.110749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.112594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.117058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.118119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 378/765] 10.222.0.70 () {56 vars in 1124 bytes} [Mon May 16 16:43:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:46.121816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.124043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:46.136194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:46.137106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:46.138017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:46.138017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:46.138017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:46.138017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:46.138017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 388/766] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:46.142932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.226668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d435e7-069f-413c-b942-55ee07685887 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.240373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5134e-0828-43c0-b98c-dcfe685c59fa None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.260692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.261702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.262210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.262682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.263606 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:46.264110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.265661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.272931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 379/767] 10.222.0.70 () {56 vars in 1124 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:46.277766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.277766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.277766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.277766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.278101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:46.278101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.278101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.279383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.290442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 389/768] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:46.295711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.392034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81d33-133e-41e4-b0a5-9eddaedfc9df None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.399639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4275fc-a323-49e1-9e84-602ba0b83625 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.427457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.429018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.429508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.430144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.431198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] RBAC: Adding query filter params (interface=public, service_id=813d5139b19c4a798a8f7bc6e1e23f15, region_id=RegionOne) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:46.431864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.433296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.433797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.434122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.434396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.434664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.441389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.443447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.443950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 380/769] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/endpoints?service_id=813d5139b19c4a798a8f7bc6e1e23f15&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:46.449384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:46.458165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:46.459564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:46.460464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 390/770] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:46.465430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.553549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ca7d2-7d4b-40c2-8cb7-c07ac8b78535 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.563651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab9bb3-709b-4114-bf21-a6af6892dcb6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.588756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.589795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.590286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.590759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.591689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.593269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.599162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.599660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 381/771] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:46.599768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.599974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.605823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.605823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:46.605823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.605823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e983-ca04-4afc-b943-e836e13106d2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.616268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 391/772] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:46.622382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:46.762620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2350477-247e-4dfb-8352-4719d645bfe6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:46.801395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:46.803102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.803708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.804207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.805344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=51eb6844e80e49bbbbdeb0df5980acd0) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:46.805975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:46.807708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78bc6-fbf8-4c33-8e2d-18268d4faae7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:46.815037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 382/773] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:46 2022] GET /identity/v3/role_assignments?user.id=51eb6844e80e49bbbbdeb0df5980acd0&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:46.988954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d58165-a752-4831-99ff-cfee67dc20d6 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.990550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d58165-a752-4831-99ff-cfee67dc20d6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:46.991030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d58165-a752-4831-99ff-cfee67dc20d6 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:46.993020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 392/774] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:46.999310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:46.999930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:47.000406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:47.026698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:47.028373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:47.100286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 383/775] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:47.124968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d58165-a752-4831-99ff-cfee67dc20d6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:47.251987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d58165-a752-4831-99ff-cfee67dc20d6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:47.338070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:47.339164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:47.339615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:47.340038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] PATH_INFO: `/v3/services/network` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:47.340845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:47.342419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-1b0b111f-dd45-432a-a0dd-be7b26c7c8ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:47.360705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:47.361754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:47.362872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:47.371624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:47.374090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 393/776] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:47 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:47.503564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5d3f-41ff-4a61-ba2b-18b572f2456f None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:47.503874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5d3f-41ff-4a61-ba2b-18b572f2456f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:47.504105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5d3f-41ff-4a61-ba2b-18b572f2456f None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:47.509608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 394/777] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:47.511240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2934d-234e-4aec-b734-79438854a725 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:47.511521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2934d-234e-4aec-b734-79438854a725 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:47.511795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2934d-234e-4aec-b734-79438854a725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:47.553921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-07c2934d-234e-4aec-b734-79438854a725 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:47.555102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-07c2934d-234e-4aec-b734-79438854a725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:47.581370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cb70f-b29c-4508-9f37-21f90a09034c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:47.681847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:47.681847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:47.681847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:47.681847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:47.682228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] RBAC: Adding query filter params (name=network) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:47.682228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:47.682228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:47.698472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 384/778] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:43:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:47.705674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:47.728150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 395/779] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:47.775003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2934d-234e-4aec-b734-79438854a725 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:47.911002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7dc5e-4331-4cfd-9867-d208eb30c613 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:47.977175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:47.977803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:47.981772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:47.981772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:47.981999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] RBAC: Adding query filter params (type=network) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:47.982250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:47.983654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:47.999382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 385/780] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:43:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:48.003804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:48.023849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2934d-234e-4aec-b734-79438854a725 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:48.093290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:48.094171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.094449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.094769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.122390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:48.130017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:48.130945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:48.131786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 396/781] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:48.139385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:48.167976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd7525-d014-4ec2-baf1-bb2585f0d190 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:48.208593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:48.210620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.210911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.211186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.211976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] RBAC: Adding query filter params (interface=public, service_id=7aff10f387ee46e38c24416f3bdba70f, region_id=RegionOne) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:48.212283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:48.213650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:48.219758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 386/782] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/endpoints?service_id=7aff10f387ee46e38c24416f3bdba70f&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:48.225775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:48.308498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cb129-baaa-4baa-9a0c-6595a59ad860 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:48.360710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:48.361385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.361657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.361952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.362967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:48.363266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:48.364675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:48.381275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 397/783] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:48.387595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:48.476422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23b74d-8790-4f10-bc76-6f2637798584 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:48.524678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bd19e-eeb3-4af1-b116-9fe383d2fea5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:48.558810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:48.560265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.561631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.562482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:48.562982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.563882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:48.564866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.566490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:48.566976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.567487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.579937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 387/784] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/services => generated 772 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:48.592306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:48.594226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-b2aac111-aef0-47d4-914c-513d47fd90db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:48.617519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:48.618511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:48.619395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:48.619395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:48.619395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:48.619395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:48.621806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 398/785] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:48.627347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:48.634397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efef37-3d42-494d-bd0f-cf41f8586c93 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.634957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efef37-3d42-494d-bd0f-cf41f8586c93 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.635408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efef37-3d42-494d-bd0f-cf41f8586c93 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.637231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 399/786] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:48.648820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.649450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.650029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.686179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:48.689126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:48.793767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f367-b80e-4fe4-811c-d1a68d87e61a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:48.825792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:48.826390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:48.826670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:48.826945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:48.827674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:48.827977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:48.829367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:48.829819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 400/787] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:43:48.847092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 388/788] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:48.853197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:48.861656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.004553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6ee8-5588-47da-9b70-ff88a78c6881 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.054436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.055243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.055514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.055784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.063897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.065368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.076014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb653cc-996a-47af-9169-5fef899d271a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:49.081628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:49.082557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:49.083613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:49.084588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 401/789] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:49.090096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.151330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.152130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.152458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.152737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.170405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:49.182552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:49.183510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:49.184347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:49.191400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 389/790] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:49.193080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.245809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351a95c-5750-404f-920b-67820e5e2515 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.309120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.310205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.310716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.311202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.312262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:49.315798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.318095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.337902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 402/791] 10.222.0.70 () {56 vars in 1135 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:49.343786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.367597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec357dc-1ee3-4c94-8648-d6be77d17bd9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.442248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.443492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.443771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.444045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.444803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:49.445109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.446514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.456430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 390/792] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:49.462101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.542014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3642b-3035-44aa-ac16-3ec66485ff83 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.576586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.577380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.577657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.577956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.588413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.589766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.600102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb87d2-b6dc-45c4-8e56-aefe68732d19 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-3cfdc60a-a469-42db-baf6-8ab93a35144e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:49.607654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:49.608567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:49.610088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:49.610088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:49.610088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:49.610088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:49.610088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 403/793] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:49.610487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b45c5-b939-4a0b-8311-a75710f3ede1 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.610757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b45c5-b939-4a0b-8311-a75710f3ede1 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.611032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b45c5-b939-4a0b-8311-a75710f3ede1 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.617266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 404/794] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:49.617266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97bb36-6ab8-4737-aba0-bbdfc9bc4abd None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.617266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97bb36-6ab8-4737-aba0-bbdfc9bc4abd None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.617266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97bb36-6ab8-4737-aba0-bbdfc9bc4abd None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.617266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 405/795] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:49.618379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97bb36-6ab8-4737-aba0-bbdfc9bc4abd None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.646141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.646931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.647212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.647500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.657910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.659383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-9f66c956-732b-44ba-ad99-411380aeb06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:49.676680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:49.678436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:49.679326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:49.679326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:49.679326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:49.679326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:49.679326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 391/796] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:49.680200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.680527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.680749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.705069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:49.706291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:49.719794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97bb36-6ab8-4737-aba0-bbdfc9bc4abd None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.754056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.754841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.755127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.755398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.756109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:49.756412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.757885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134aaf-b449-4f26-8af2-34b8aaf35cd8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.769093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 406/797] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:49.770573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.771062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.771546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.777775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 392/798] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:49.778601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.792120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:49.793290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:49.859456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 407/799] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:49.860678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.888464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d33682-05c8-418e-bf93-c27214381e3d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:49.921720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:49.922410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:49.922692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:49.922965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:49.923678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:49.923983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:49.925352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:49.941006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 393/800] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:49.941006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:49.977251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33157d2b-fe2a-471e-be26-ec8a99b8257e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.009231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.010052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.010330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.010598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.017148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.018615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:50.032377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:50.033293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:50.034242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 408/801] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:50.034727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.048570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea901e-c161-4534-b54f-834fc284b092 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.081059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.081889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.082164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.082426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.083579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.084930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:50.096673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:50.097592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:50.098969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 394/802] 10.222.0.70 () {56 vars in 1129 bytes} [Mon May 16 16:43:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:50.099809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.140625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec59531-3220-457e-8764-3933cb674c6c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.176473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.178125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.178810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.179234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.189374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:50.197710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:50.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:50.199852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:50.200612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1e70e-cd68-4c97-932f-4345f5fa6815 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.206905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 409/803] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:50.207891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.231183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.231966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.232240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.232503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.240476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.241932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:50.255138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:50.256266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:50.257216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 395/804] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:50.257828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.314244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235254-cc0a-49ad-856b-253a4342f3dd None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.352726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73330042-7756-4cc0-b1f6-cd8880643f19 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.354227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.355642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.355934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.356207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.356996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:50.357304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.358774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.373973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 410/805] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:50.374778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.389842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.390680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.391005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.391374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.392173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:50.392597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.394079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.398769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 396/806] 10.222.0.70 () {56 vars in 1124 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:50.399720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.485378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dced1-0d11-4ab8-b952-c446b4f3a6a4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.502040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbac14c-1a1a-4107-b610-e765f40cdd71 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.519699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.520547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.520955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.521305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.522148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:50.522529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.523972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.532291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 411/807] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:50.532837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.540233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.540904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.541204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.541443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.542316 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:50.542618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.544031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.562380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 397/808] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:50.563405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.637601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6071e-2436-465a-aeb7-aea52b03828c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.665443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03212-1696-4cc2-8ec8-0222d00402dc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.670399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.671280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.671547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.671818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/15960410c990447c9773da8ae5be7cb7/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.673761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=15960410c990447c9773da8ae5be7cb7, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.675204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.697770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 412/809] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:50 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/15960410c990447c9773da8ae5be7cb7/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:50.697770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.714819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.715505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.715785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.716060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.716842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:50.717150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.718591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.725003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 398/810] 10.222.0.70 () {56 vars in 1124 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:50.726022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.799323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368d66-e621-4181-b277-7767df6e3cf5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.830117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684a3c-68f3-45b2-89b6-11483fbab924 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:50.835928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.836730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.837004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.837326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.849798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.851283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.867708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:50.868371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:50.868651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:50.868924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:50.872270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:50.873204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:50.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:50.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:50.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:50.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:50.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 413/811] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:50.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:50.949697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:50.951100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:50.984023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1732981-af44-4637-a5f7-1f67b6929fb2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.018011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.020410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.020932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.021402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.022363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.023953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.046195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 414/812] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:43:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:51.050742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.053787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 399/813] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:43:51.059924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.179088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f869ca-c199-4591-be3e-58e6cca5b58d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.202210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f0c48-fec1-4bc6-8efd-ec0a545f02f2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.222152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.223127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.223415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.224234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.238559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.241447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.245036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.245865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.246216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.246559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.247371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:51.247682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.249097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ed60a-094f-4f78-a374-e15f2efa0deb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-92f09b14-37a3-47b6-9f4b-a8775a836a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:51.261353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:51.262437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 400/814] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2f7f-bcb5-4174-aa10-ea7ebc5df7e1 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2f7f-bcb5-4174-aa10-ea7ebc5df7e1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.269484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2f7f-bcb5-4174-aa10-ea7ebc5df7e1 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.271116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 401/815] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:51.273790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 415/816] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:51.274442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.274730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.275005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.277096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2f7f-bcb5-4174-aa10-ea7ebc5df7e1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.294926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:51.296617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:51.378098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 416/817] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:51.379251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.426468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2f7f-bcb5-4174-aa10-ea7ebc5df7e1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.462414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.463114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.463518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.463895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.464768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:51.465172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.467009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.480042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 402/818] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:51.484529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.505834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff76f1-1ad9-40c7-a66b-2b2e29cc77b0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.540667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.541768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.542217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.542638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.550207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.551946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:51.567129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:51.568223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:43:51.569172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:51.571827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 417/819] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:51.572865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.587358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e438e-bf40-4327-9156-1a3314ab0943 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.621561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.622519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.622866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.623301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] PATH_INFO: `/v3/services/network` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.623972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.625510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:51.637385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:51.638447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 16 16:43:51.639332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:51.643591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 403/820] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:51.644492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.678094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e928a0-3425-4cf2-839d-4d28a746f7ad None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.715294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.716397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.716882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.717380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.724517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.726322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:51.740513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:51.741407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:51.742642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:51.749160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fff99-6f8b-492b-bc3e-8f04e922efa9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.749464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 418/821] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:51.750536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.781271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.781965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.782243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.782518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.783425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:51.783647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.785183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.802971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 404/822] 10.222.0.70 () {56 vars in 1149 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:51.803805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.856358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed698-a4bf-4911-8944-206c681ee796 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.894002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.894826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.895207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.896376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.897005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:51.897419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.898915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.908462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 419/823] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:51.908462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:51.920634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90d95-3f00-41f1-8c18-d30daab3a7f0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:51.955564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:51.956525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:51.956961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:51.957388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:51.958927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:51.959382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:51.960988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:51.973447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 405/824] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:51.974630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.015348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431d407-a87d-4d7a-a0e2-8bf3e8f5b0d8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.048958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.049927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.050309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.050683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.061769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.063359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.077347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae8e36-a298-4e84-87fd-04479d0b31b2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:52.081427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:52.082602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:52.083803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:52.083803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:52.083803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:52.083803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:52.085273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 420/825] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:52.086229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.114654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.115574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.116003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.116438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.117291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] RBAC: Adding query filter params (type=network) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:52.117790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.119384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.129108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 406/826] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:43:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:52.130782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.186509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c13ba3-ca46-4a01-95e5-0b3de02f373b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.219990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.220866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.221452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.221581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.222558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=fc0134f8e7c1401eb79c443f67174a0f) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:52.222963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.224881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.231089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35fa41-34ee-4e3f-86a8-e8b0a4661861 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.238149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 421/827] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:52 2022] GET /identity/v3/role_assignments?user.id=fc0134f8e7c1401eb79c443f67174a0f&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:52.239759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.268548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.269520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.269977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.270442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.271330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:52.271862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.273512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.287380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 407/828] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:52.295148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.445589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85711d10-0907-499f-88d9-9e655ae32e3d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.497981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.498304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1b030-fb6f-443d-812d-8863ba5d98ed None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.498725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.499104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.499382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.500132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.501515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.527196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 422/829] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:43:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:43:52.563127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.564230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.564753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.565179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.573827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.577081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:52.592718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:52.593929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:52.595023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:52.597409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 408/830] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:52.603743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.726135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b081-d85d-4cbd-8318-633047d9f8b3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.760970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.761714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.762119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.762491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.763376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:52.763798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.765336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9ef3-d47e-4220-8d1f-b5278f40f2cd None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.779123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 423/831] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:52.784845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:52.896153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a2e1-fb2d-4b2a-a0e3-9d4df282ca41 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:52.938069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab24ec-f236-4815-8354-a5e87dfdb3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:52.938973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab24ec-f236-4815-8354-a5e87dfdb3ac None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:52.939247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab24ec-f236-4815-8354-a5e87dfdb3ac None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:52.939513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab24ec-f236-4815-8354-a5e87dfdb3ac None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/51eb6844e80e49bbbbdeb0df5980acd0/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:52.955263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab24ec-f236-4815-8354-a5e87dfdb3ac None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=51eb6844e80e49bbbbdeb0df5980acd0, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:52.956704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab24ec-f236-4815-8354-a5e87dfdb3ac None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:52.973620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 409/832] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:43:52 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/51eb6844e80e49bbbbdeb0df5980acd0/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:43:53.042858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa1c4a-6a06-4197-87a0-fb61b9f3f904 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.043241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa1c4a-6a06-4197-87a0-fb61b9f3f904 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.043611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa1c4a-6a06-4197-87a0-fb61b9f3f904 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.045468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 424/833] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:53.052175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.052613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.053005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.071694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:53.072974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:53.152191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 410/834] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:53.175955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa1c4a-6a06-4197-87a0-fb61b9f3f904 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.280851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa1c4a-6a06-4197-87a0-fb61b9f3f904 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.315335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.316046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.316321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.316589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.327299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:53.335313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:53.336511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:53.337537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 425/835] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:53.342796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.454304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84580b5c-554b-4640-a47f-0ac28dbd90e0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.487489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.488147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.488418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.488686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.490084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:53.490384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:53.491761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542656d-fa9a-48fe-8ce0-7b5ba072aed4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:53.505078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 411/836] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:53.506497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.537381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dd204-9b8b-4060-8e14-79892e6b3ef2 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.537803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dd204-9b8b-4060-8e14-79892e6b3ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.538081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dd204-9b8b-4060-8e14-79892e6b3ef2 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.545280 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 412/837] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:53.546685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.547039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.547378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.566473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:53.568296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:53.613048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c31be3-b926-483b-9fa8-436dd9a67509 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.646525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.647438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.647919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.648113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.658282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 413/838] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:53.664007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:53.665511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:53.677558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:53.690938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:53.691843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:53.693311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:53.693311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:53.693311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:53.693311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:53.697339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 426/839] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:53.698661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.784090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0914d-c269-4e64-945d-6048bb9f617e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.800569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2766a2-3e2d-4b8d-8d66-b38e469a55e0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.820971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.822133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.822651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.823135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.824007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:53.825605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:53.834959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.835616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.835888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.836154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.836868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:53.837168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:53.838549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:53.840226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:53.841262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:43:53.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:53.849783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 414/840] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:53.850896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.855297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 427/841] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:43:53.856048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:53.952433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee548481-5487-4c30-a9e0-13e751c0ee95 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.953703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a79e48-f64f-4ae8-96a8-c88c2270f542 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:53.990105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.990894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.991167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.991433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:53.997035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:53.998250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:53.998737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:53.998845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:53.999333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.000193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.000457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:54.001151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:54.003448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.013143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 415/842] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:54.014242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:54.014492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:54.015426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 16 16:43:54.016387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:54.020173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 428/843] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:43:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:54.021726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:54.122733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30478-3101-4d87-b02b-3bbd78dff172 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:54.142632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751423f-9097-400d-82eb-3c093d496fd2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:54.158164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:54.159473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.159954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.160572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.162035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:54.162731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:54.164633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.171032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 416/844] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:54.197419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:54.198163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.198439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.198703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.199548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:54.199847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:54.201305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.226040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 429/845] 10.222.0.70 () {56 vars in 1135 bytes} [Mon May 16 16:43:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:54.227770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:54.338540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22eaa6-657a-4223-8ad7-b365c636bbbc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:54.381042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:54.381677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.381922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.382198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.451742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:54.453214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.551369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 417/846] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:43:54.557378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:54.656394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03608edd-286e-46b1-854e-2c54b35aa25f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:54.694160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:54.695251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.695695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.696107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.707404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:54.709704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-1385a9ad-53c4-46ea-b995-91b8b26d9fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:54.727585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:54.728745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:54.729874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:54.729874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:54.729874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:54.729874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:54.735971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 430/847] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:54.738137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:54.837345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7237a-f1c3-4362-ba37-37fa84032e7e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:54.871330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:54.871972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa120e-b353-4dc8-954d-1a0a4117312f None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.872084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.872243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.872518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.872915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa120e-b353-4dc8-954d-1a0a4117312f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.873231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:54.873536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:54.873797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa120e-b353-4dc8-954d-1a0a4117312f None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.874939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:54.879374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 431/848] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:54.881693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:54.882208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:54.882696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:54.889776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 418/849] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:54.893517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:54.905439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:54.907732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:54.991747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 432/850] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:55.015847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.025665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba819-62ce-44b6-9fcf-4d224c2ccd6d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.065177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.066588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.067772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.068253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.076921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.079529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:55.097928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:55.098960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:55.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:55.107621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 419/851] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:55.111600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.136081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54af85-e3d6-4f03-8188-8248a0e5691f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.179199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.180815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.181284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.181906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.183023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.184813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:55.200563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:55.201527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:43:55.202385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:43:55.208564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 433/852] 10.222.0.70 () {56 vars in 1132 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:55.210046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.233616 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3e55d-9809-42fc-8244-c5e5125140fb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.276782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.278504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.278958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.279382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.280302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:55.280756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.282360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6bfc3-264a-4e47-b4fe-dfa83afdbc38 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.297791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 420/853] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:55.298889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe03c-0997-4921-8d28-134fc50ac24a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.299177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe03c-0997-4921-8d28-134fc50ac24a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.299443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe03c-0997-4921-8d28-134fc50ac24a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.300796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 421/854] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:55.305620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe03c-0997-4921-8d28-134fc50ac24a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.312793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a0c30-b0c8-4e72-ab4c-dd608054dff8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.345495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.346194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.346469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.346736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.347449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:55.347749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.349224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d6385-82f1-4fc5-aa66-99034a5e0cd0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.354267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 434/855] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:55.357724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.358191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.358646 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.375871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:55.377049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:55.427086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe03c-0997-4921-8d28-134fc50ac24a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.452509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 435/856] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:55.453115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.462163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.463527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.464010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.464811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.466195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=15960410c990447c9773da8ae5be7cb7) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:55.466718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.468766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.476611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 422/857] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/role_assignments?user.id=15960410c990447c9773da8ae5be7cb7&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:55.477660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.574686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf082-194a-43c3-93ec-ed1ce25fe7b1 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.615705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5467a5-b583-4c29-b2f3-f2bc9b936375 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.617660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.619487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.619958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.620390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.621273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:55.621794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.623948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.631282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 436/858] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:55.654815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.655713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.655990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.656312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.669033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:43:55.677517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:55.678567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:55.679392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 423/859] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:55.685127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.797448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779b6c1-9365-4030-9234-2c03c68a165b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.834595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.835267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.835543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.835813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:55.836554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:55.836854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:55.838256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:55.847521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 437/860] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:55.853411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:55.953402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007d94-a346-418c-853d-4f8a175b1e9b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:55.987619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:55.988418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:55.988697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:55.988988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.000488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:56.001981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:56.019164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:56.020096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:56.021541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:56.021541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:56.021541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:56.021541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:56.021541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 424/861] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:56.026900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:56.127695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cb500-0bb5-46ad-b726-21fced166468 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:56.161787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:56.162450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.162720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.162984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.163691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:56.163990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:56.165359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:56.177908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 438/862] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:56.186362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:56.286361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e92b4-80b3-4e9a-8666-2bd99c34787b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:56.324858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:56.325689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.326000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.326271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.335489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:56.337022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-55c6ee78-ba27-4c46-a50f-b08a2cd50bc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:43:56.351930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:56.354136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:56.356366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 425/863] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:43:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:56.361848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:56.462945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582587d0-0ae3-4bb4-90b0-9865af48e2b6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:56.496833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:56.497823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.498250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.498739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.499707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:56.500155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:56.501731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:56.504367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399326a-f6a6-4e0c-896b-05e350824636 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.505389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399326a-f6a6-4e0c-896b-05e350824636 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.505479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399326a-f6a6-4e0c-896b-05e350824636 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.507318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 426/864] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:56.512533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.512810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.513080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.526822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 439/865] 10.222.0.70 () {56 vars in 1149 bytes} [Mon May 16 16:43:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:56.532665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:56.533977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:56.535165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:56.621788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 427/866] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:56.638757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:56.652477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3334e-7adf-4c60-996e-82a4d61b00ab None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:56.694820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:56.695838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.696344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.696819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.754635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3af80-d727-43d2-bcdb-036ec1c2788b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:56.783776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:56.789096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:56.798718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:56.799567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:56.800422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:56.800802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:56.802723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:56.804560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:56.825122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 428/867] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:43:56 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:43:56.903619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 440/868] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:43:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:43:56.909416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:57.023408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc384b-c4a3-41e8-88c6-e9d2ee0761dc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:57.057634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:57.058458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.058742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.059013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.068821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:57.070426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:43:57.087750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:57.088663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:57.089558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:43:57.089558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:43:57.089558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:43:57.089558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:57.089558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 429/869] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:57.094487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:57.193876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7a917-0cab-42e4-8fe3-966bf55a763e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:57.228275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:57.228940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.229219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.229491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.230248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:57.230555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:57.231998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:57.244118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 441/870] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:57.249420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:57.355978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c621b-2c63-4535-9fc8-9500a8c88be2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:57.391286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:57.392453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.392952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.393422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.400660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:57.402402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:43:57.421764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:57.422721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:57.423636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 430/871] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:57.424575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:57.528836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856a7c-5a1c-45ee-94fa-1d7a1a8841f6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:57.563306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:57.564330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.564836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.565339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.566354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:57.566863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:57.568542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a17273-27b1-4b9d-8c2f-71b52877ebe5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:57.581200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 442/872] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:57.587407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:57.685148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005e33-978a-47b4-b680-a39f93987605 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:57.722870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:57.723582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.723856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.724123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.724985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=51eb6844e80e49bbbbdeb0df5980acd0) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:57.725291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:57.727200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2df9-e2c6-4b4a-b8df-d36b690e3e08 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:57.739336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 431/873] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:43:57 2022] GET /identity/v3/role_assignments?user.id=51eb6844e80e49bbbbdeb0df5980acd0&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:57.909704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd9df9-fada-444e-93c7-563a7d19b9fb None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.910791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd9df9-fada-444e-93c7-563a7d19b9fb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.911301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd9df9-fada-444e-93c7-563a7d19b9fb None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.913296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 443/874] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:57.919055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.919619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.920101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.931519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e65e3-a569-4715-bd85-b11a57d8ef61 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.932111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e65e3-a569-4715-bd85-b11a57d8ef61 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.932589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e65e3-a569-4715-bd85-b11a57d8ef61 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.934469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 444/875] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:43:57.942566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:57.943970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:57.944082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:57.944082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:57.944082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:57.961477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:57.963006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:58.018826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 432/876] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:58.043037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:58.049526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 445/877] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:43:58.081102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:58.164543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5635e1-9b03-4cd7-b2eb-301eb82bc4a9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:58.184343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91989846-7948-4fe9-96e8-e505d3b31486 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:58.198254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:58.198985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:58.199261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:58.199531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:58.200251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:58.201683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:58.214482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:58.215477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:58.216315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 433/878] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:43:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:43:58.221984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:58.225586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:58.226289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:58.226569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:58.226841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:58.227633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:58.229083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:58.247301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 446/879] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:43:58 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:43:58.337866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161fdbe-0ce5-42b3-a836-56c81cab8629 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:58.380021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:58.380691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:58.380966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:58.381232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:58.381968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:58.382338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:58.383736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1325c8e-0707-4cf3-9792-a9cdec4b9fa7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:58.389229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 434/880] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:43:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:58.394702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:58.515138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772194-ca62-4192-af59-ba9a3f855516 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:58.549372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:58.550424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:58.550911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:58.551413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:58.552315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:58.552859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:58.554456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df05efc-3b83-4ad0-b04c-8ab7971c196f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:58.559619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 447/881] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:43:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:59.200628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3c3f5-d04f-40c8-abd2-aff2c3653053 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:59.201174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3c3f5-d04f-40c8-abd2-aff2c3653053 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:59.201174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3c3f5-d04f-40c8-abd2-aff2c3653053 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:59.202832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 435/882] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:43:59.208041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:59.208858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:59.209338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:59.226433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:43:59.227852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:43:59.292671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 448/883] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:43:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:43:59.315597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3c3f5-d04f-40c8-abd2-aff2c3653053 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:59.421984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3c3f5-d04f-40c8-abd2-aff2c3653053 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:59.456091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:59.456799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:59.457070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:59.457335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:59.458577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:59.459934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:43:59.471565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:43:59.472537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:43:59.473399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 436/884] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:43:59.480637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:59.577860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2538e1-79c0-4232-b956-6d66831be92f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:59.612616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:59.613278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:59.613557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:59.614387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:59.615087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:59.615390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:59.616762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:59.621635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 449/885] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:59.627147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:59.727515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb82626-92f2-4786-bcd3-e6242c1f4b3c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:59.763151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:59.763815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:59.764087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:59.764352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:59.765048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:59.765345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:59.766736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:59.772065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 437/886] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:43:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:59.777874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:43:59.875400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e43f9d-1fa8-483e-ac75-e01b73cb1f4f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:43:59.914460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:43:59.915117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:43:59.915392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:43:59.915660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:43:59.916553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] RBAC: Adding query filter params (interface=public, service_id=54634e5abc7f46e09e0a081150236419, region_id=RegionOne) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:43:59.916857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:43:59.918362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8bc76-0fdf-4820-aa3e-e2c5f86436ab None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:43:59.926081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 450/887] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:43:59 2022] GET /identity/v3/endpoints?service_id=54634e5abc7f46e09e0a081150236419&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:43:59.934843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.037770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b56a-8b1e-4c01-9463-bbd59f479cc0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.070667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c7c6-8ce5-4784-a7a5-2a85d21a4299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:00.071666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c7c6-8ce5-4784-a7a5-2a85d21a4299 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.072250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c7c6-8ce5-4784-a7a5-2a85d21a4299 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.072723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c7c6-8ce5-4784-a7a5-2a85d21a4299 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.073593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c7c6-8ce5-4784-a7a5-2a85d21a4299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:00.075171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c7c6-8ce5-4784-a7a5-2a85d21a4299 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:00.081309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 438/888] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:43:59 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:44:00.188559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc84cc-5a85-481d-b3de-4e1db115ca6e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.188889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc84cc-5a85-481d-b3de-4e1db115ca6e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.189117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc84cc-5a85-481d-b3de-4e1db115ca6e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.190813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 451/889] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:00.197047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.197347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.197608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.215592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:00.216792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:00.290463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 439/890] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:00.314403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc84cc-5a85-481d-b3de-4e1db115ca6e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.420777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc84cc-5a85-481d-b3de-4e1db115ca6e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.454870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f51116-b4d8-4421-a3ce-8eecad6237be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:00.455677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f51116-b4d8-4421-a3ce-8eecad6237be None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.455944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f51116-b4d8-4421-a3ce-8eecad6237be None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.456205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f51116-b4d8-4421-a3ce-8eecad6237be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.466886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f51116-b4d8-4421-a3ce-8eecad6237be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d5f51116-b4d8-4421-a3ce-8eecad6237be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:00.475447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:00.476368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:00.477225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 452/891] 10.222.0.70 () {56 vars in 1120 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:00.482576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.541108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760076-ae0d-4027-b00d-eae2ff51e884 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.541407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760076-ae0d-4027-b00d-eae2ff51e884 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.541572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760076-ae0d-4027-b00d-eae2ff51e884 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.543223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 453/892] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:00.547849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.548135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.548404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.565608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:00.566816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:00.583943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64707c7c-60cb-487e-b23f-f3ec4ea8b3a9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.617654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:00.618345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.618619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.618889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.619626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:00.619923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:00.621284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:00.629612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 440/893] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:00.635486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.637476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 454/894] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:00.659828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.755083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c90013-6809-4e2c-88ac-62c591b265cf None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.768772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318fbe9-294e-4929-86e6-edc38ca61e19 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.801185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:00.801957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.802534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.802815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.807432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:00.808474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.808932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.809383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.810266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:00.811822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:00.814830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:00.816571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:00.825148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:00.826118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:44:00.826966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:00.829906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 455/895] 10.222.0.70 () {56 vars in 1132 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:00.840611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:00.841521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:00.842490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:00.842490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:00.842490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:00.842490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:00.842709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.842795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 441/896] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:00.842795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:00.950785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87903e20-4b84-4ce3-8895-88a73be95efa None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.965486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5697ad-79b9-409c-9177-3975570adbf4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:00.986326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:00.987245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.987523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.987795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.988508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:00.988836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:00.990258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0c008-8e61-4483-b3c8-0503b65220dc None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:00.999145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 456/897] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:00.999145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507821c8-269a-4805-a12a-ef22aca70716 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:00.999145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507821c8-269a-4805-a12a-ef22aca70716 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:00.999145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507821c8-269a-4805-a12a-ef22aca70716 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:00.999145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 457/898] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:01.000744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507821c8-269a-4805-a12a-ef22aca70716 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.008410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.009078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.009357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.009632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.010382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:01.010684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.012049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3184039-50f3-4169-a9a2-fff1c0e3167d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.028916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 442/899] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:01.028916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.028916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.028916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.043484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:01.044660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:01.102850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507821c8-269a-4805-a12a-ef22aca70716 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.107158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 443/900] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:01.108223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.136604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.137445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.137895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.138276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.139051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:01.139424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.140876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.150288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 458/901] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:01.150288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.223625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579027c0-27ee-4f2f-a56c-b43eb208e016 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.245431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443b4a6-d78e-45cb-8ffb-23f25c3395e8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.258128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.258947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.259221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.259488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.266976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.268427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.280037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.280695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.280975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.281243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.281986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:01.283053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:01.284023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:44:01.285064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:01.286273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.286347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 444/902] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:44:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:01.286347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.303512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 459/903] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:44:01 2022] POST /identity/v3/services => generated 241 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:01.304718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.419506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2665aa-ce56-411a-be6e-c996380da984 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.448141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736342c8-fe48-46a6-bef0-b4f72abda393 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.459025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.460107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.460656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.461146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.462203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] RBAC: Adding query filter params (interface=public, service_id=687e0d02650541f1b64ee711cfbb4829, region_id=RegionOne) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:01.462738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.464364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.470639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 445/904] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:44:01 2022] GET /identity/v3/endpoints?service_id=687e0d02650541f1b64ee711cfbb4829&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:01.476411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.501011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092398-65df-478d-87db-b54587194d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.502057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092398-65df-478d-87db-b54587194d70 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.502543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092398-65df-478d-87db-b54587194d70 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.502865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092398-65df-478d-87db-b54587194d70 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.503782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092398-65df-478d-87db-b54587194d70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:01.504163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092398-65df-478d-87db-b54587194d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.505672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092398-65df-478d-87db-b54587194d70 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.525362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 460/905] 10.222.0.70 () {56 vars in 1149 bytes} [Mon May 16 16:44:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:01.533866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092398-65df-478d-87db-b54587194d70 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.604759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2a4d-8994-4efa-81f4-dfdf82f385e5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.636977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092398-65df-478d-87db-b54587194d70 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:01.642174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.643082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.643522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.643950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.644790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.646522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.652997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 446/906] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:44:01 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:44:01.673386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:01.674013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:01.674293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:01.674563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:01.750172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:01.751707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:01.867083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 461/907] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 16:44:01.875836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:01.983698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037edfa-686d-4539-bc76-28ed382ec7e0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.017886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.019045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.019530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.020555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.031008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.032756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:02.051833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:02.052812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:02.053765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:02.053765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:02.053765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:02.053765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:02.056087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 447/908] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:02.061765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.159373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df194-b1b9-4b46-ac97-023bc98a57b2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.199534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.200198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.200472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.200740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.201467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:02.201784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.204602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.222223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 462/909] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:02.228206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.328776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568d7aa-3faf-48ae-80e7-1ba2628af5fc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.362162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.363437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.363949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.364400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.371360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.373056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b0177aeb-c63a-4505-9f57-a6d4f77ef295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:02.387588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:02.388478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:02.389367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:02.391524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 448/910] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:02.397948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.406590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9d33-3131-4f57-b0f0-d0850bbc670a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.406873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9d33-3131-4f57-b0f0-d0850bbc670a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.407151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9d33-3131-4f57-b0f0-d0850bbc670a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.408800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 449/911] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:02.414042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.414322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.414685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.433977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:02.435213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:02.504172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89845397-feeb-4e7c-acb0-ca9a51b5f02e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.513864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 450/912] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:02.530032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.554191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.555758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.556428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.557100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.558695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:02.559449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.561897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.577783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 463/913] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:02.586497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.643147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd166259-5478-41f3-9ccb-be50c281c4e5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.676112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.677574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.677794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.678031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.678815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.680178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:02.691718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:02.693343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:02.694236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 451/914] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:02.702492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59360424-c72f-4ce0-a51a-944fc42c074f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.702762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.737983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.739959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.740723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.741227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.742295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] RBAC: Adding query filter params (role.id=6b461d0b106c457ca6c4a91841818d94, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=51eb6844e80e49bbbbdeb0df5980acd0) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:02.742940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.745373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.752615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 464/915] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/role_assignments?user.id=51eb6844e80e49bbbbdeb0df5980acd0&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=6b461d0b106c457ca6c4a91841818d94 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:02.818492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac015ac5-8499-4014-9b20-f2397799ed9b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:02.857477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:02.858107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:02.858381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:02.858655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:02.859432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:02.859734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:02.861178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:02.871710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 452/916] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:02.874885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:02.991573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820ff6-63d6-4403-8522-f42eee71e2dd None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:03.025471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:03.026163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:03.026445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:03.026766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:03.027469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:03.027820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:03.029195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7515ef-a54a-4911-bec0-12ce7de65f80 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:03.037846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 465/917] 10.222.0.70 () {56 vars in 1114 bytes} [Mon May 16 16:44:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:03.040139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:03.142262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaab9f-8686-47b3-9f2d-40fbbcfec15a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:03.175166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab409a-f498-4d33-9481-fd20543978dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:03.175817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab409a-f498-4d33-9481-fd20543978dc None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:03.176097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab409a-f498-4d33-9481-fd20543978dc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:03.176362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab409a-f498-4d33-9481-fd20543978dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:03.177096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab409a-f498-4d33-9481-fd20543978dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:03.178482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab409a-f498-4d33-9481-fd20543978dc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:03.205879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 453/918] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:44:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:03.779968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01873e2c-b6c8-499d-bc89-e37554c25acd None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:03.780483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01873e2c-b6c8-499d-bc89-e37554c25acd None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:03.780483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01873e2c-b6c8-499d-bc89-e37554c25acd None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:03.782073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 466/919] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:03.788152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5da6c-1494-42bf-9d77-c94d718d0ee0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:03.788554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5da6c-1494-42bf-9d77-c94d718d0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:03.788760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5da6c-1494-42bf-9d77-c94d718d0ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:03.808143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e6b5da6c-1494-42bf-9d77-c94d718d0ee0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:03.809351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e6b5da6c-1494-42bf-9d77-c94d718d0ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:03.889854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 454/920] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:03.905998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01873e2c-b6c8-499d-bc89-e37554c25acd None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:03.999138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568a66-a440-4560-95b3-3ee2c80087b7 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:03.999488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568a66-a440-4560-95b3-3ee2c80087b7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:03.999668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86568a66-a440-4560-95b3-3ee2c80087b7 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.001847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 455/921] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:04.013074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.016022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.016403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.024425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01873e2c-b6c8-499d-bc89-e37554c25acd None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.034426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:04.036186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:04.077822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.078773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.079148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.079531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.080282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.081762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:04.094562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:04.095589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:04.096410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:04.101543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 467/922] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:04.102764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.110448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 456/923] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:04.133158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.212816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663a74-2b58-4b2b-8560-8f67bad3895c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.245542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.246330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.246514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.246768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.247456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:04.247750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.249106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.258407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 468/924] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:04.259275 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418aec-e54b-400e-a5a7-1cdfcbbd9c92 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.259641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.298757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.299948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.300441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.300921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.301900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.303790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:04.316266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:04.317672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 16 16:44:04.318823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:04.321326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 457/925] 10.222.0.70 () {56 vars in 1132 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:04.327810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.369970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25ddc0-9e5f-4014-ab37-7893aac135b4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.403981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.404627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.404944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.405215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.406103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:04.406255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.407661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.424499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 469/926] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:04.425983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.457578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7c13a-26fa-4339-a316-dbaeacdd5c1b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.501491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.502741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.503084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.503421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.505088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:04.505480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.507569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.517836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 458/927] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:04.521162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.532712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4deba4-c363-472a-8db5-fa49ffc06855 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.566767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.567916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.568196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.568517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.569308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] RBAC: Adding query filter params (interface=public, service_id=53b71ecf3f2c44dab29b214135ea28c0, region_id=RegionOne) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:04.569619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.571180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.580716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 470/928] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/endpoints?service_id=53b71ecf3f2c44dab29b214135ea28c0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:04.584488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.634373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0745b4-e4dd-4957-944f-eb73cb0e2cce None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.678389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.679721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.680306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.680879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.682112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:04.682525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.684089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.693883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 459/929] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:04.696028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:04.712870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abdff7-0f83-4649-b6e2-ff1d2f12f020 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.746753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04044a68-c7fc-47eb-87a0-7a588f616230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.747659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04044a68-c7fc-47eb-87a0-7a588f616230 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.748085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04044a68-c7fc-47eb-87a0-7a588f616230 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.748527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04044a68-c7fc-47eb-87a0-7a588f616230 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.749343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04044a68-c7fc-47eb-87a0-7a588f616230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.750890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04044a68-c7fc-47eb-87a0-7a588f616230 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.766192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 471/930] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:44:04 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:44:04.805480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1dc6-8dd4-4bd1-a724-12186217ff1b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:04.843179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610dc176-8527-4e6f-9823-06a84d382a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:04.843864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dc176-8527-4e6f-9823-06a84d382a0a None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:04.844146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dc176-8527-4e6f-9823-06a84d382a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:04.844423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610dc176-8527-4e6f-9823-06a84d382a0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:04.845185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dc176-8527-4e6f-9823-06a84d382a0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:04.846676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610dc176-8527-4e6f-9823-06a84d382a0a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:04.871870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 460/931] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:44:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:05.111177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e2b5d-64b7-44c9-b2d0-37ce71a1ecf4 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.111678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e2b5d-64b7-44c9-b2d0-37ce71a1ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.111678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e2b5d-64b7-44c9-b2d0-37ce71a1ecf4 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.113511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 472/932] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:05.118953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.119243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.119520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.136246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:05.137424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:05.209477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 461/933] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:05.232599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e2b5d-64b7-44c9-b2d0-37ce71a1ecf4 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:05.338729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e2b5d-64b7-44c9-b2d0-37ce71a1ecf4 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:05.378273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:05.379024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.379836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.380110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.392696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:05.401708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:05.402772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:05.404075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 473/934] 10.222.0.70 () {56 vars in 1120 bytes} [Mon May 16 16:44:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:05.410774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:05.514203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec1d08-1c60-4409-938d-77c8e99f9a41 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:05.548297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:05.548967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.549298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.549576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.550393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:05.550700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:05.552613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e6ae-66fb-48cd-8b41-ac08bd261df4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:05.561024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 462/935] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:05.566693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:05.568080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed40a6-b4be-449f-922a-0af7842cda94 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.568370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed40a6-b4be-449f-922a-0af7842cda94 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.568645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed40a6-b4be-449f-922a-0af7842cda94 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.570242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 463/936] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:05.575329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.575616 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.575898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.591940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:05.593123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:05.665918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 464/937] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:05.682544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa837a-8e75-452b-8b91-6c1523aaf057 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:05.685523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:05.723287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:05.724470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.724774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.725047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.738497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:05.741098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:05.760174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:05.762307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:05.764239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:05.764239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:05.764239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:05.764239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:05.764239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 474/938] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:05.767826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:05.791288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c800c11-a437-4236-86c9-8634ca0ed49f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:05.833327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:05.834179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.834769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.835179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.836006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:05.838222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:05.839581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING keystone.server.flask.common [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 16 16:44:05.860953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.sql.core [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 16:44:05.860953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 16:44:05.860953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [parameters: {'id': '57d44d0ff1f04471ab6aab442f02fa8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 16:44:05.860953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79956) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 16:44:05.874909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e149f6-7885-4513-808f-5768ee7b3cf1 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 57d44d0ff1f04471ab6aab442f02fa8c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 57d44d0ff1f04471ab6aab442f02fa8c. May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result = self._query(query) May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application conn.query(q) May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 16:44:05.883259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result.read() May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 16 16:44:05.884943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return project_ref.to_dict() May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application next(self.gen) May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application yield resource May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application next(self.gen) May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.session.rollback() May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.force_reraise() May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise self.value May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application session.commit() May 16 16:44:05.886980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._prepare_impl() May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.session.flush() May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._flush(objects) May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application compat.raise_( May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application flush_context.execute() May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 16:44:05.888842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rec.execute(self) May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application c = connection._execute_20( May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 16:44:05.895426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result = self._query(query) May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application conn.query(q) May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result.read() May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 16:44:05.896393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [parameters: {'id': '57d44d0ff1f04471ab6aab442f02fa8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:05.897466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:05.898463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.Conflict( May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 57d44d0ff1f04471ab6aab442f02fa8c. May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 465/939] 10.222.0.70 () {60 vars in 1140 bytes} [Mon May 16 16:44:05 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:05.899838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:05.917429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:05.918216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:05.918568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:05.918924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:05.919708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:05.920079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:05.921570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:05.934467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 475/940] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:05.939757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.017457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33fcdf-e814-4b4d-9d88-b8e662f02ae6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.060964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.062235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.062804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.063083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.067600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb138c-174a-4adf-9813-5144deada93c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.073222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.075021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:06.094320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:06.096405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:06.099176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 466/941] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:06.102600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.108411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.108798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.109078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.109346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.117837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.119292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:06.135019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:06.135985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:44:06.136999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:06.141173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 476/942] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:44:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:06.142041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.211601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680c57b-e377-4f0c-8f71-b63200cbe948 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.241968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb2af5-ef26-46f5-b891-f54d46e81b10 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.244502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.245477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.245477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.245681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.246475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:06.246776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.248225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.277775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 467/943] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:06.288940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.289682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.289999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.290269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.291182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:06.291486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.292953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.313874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 477/944] 10.222.0.70 () {56 vars in 1149 bytes} [Mon May 16 16:44:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:06.319609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.429473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b118a0-7707-46c7-b474-a06ddec74614 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.470372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.471164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.471444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.471701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.482650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.484105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:06.502409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:06.503344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:06.504243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:06.504243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:06.504243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:06.504243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:06.504243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 468/945] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:06.510742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.610960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34944-536a-466b-bb25-5dcf26c75cae None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.643936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.644602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.645389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.645708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.646435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:06.646733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.648163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.659641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 478/946] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:06.665863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.769379 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04e0c-fea4-4e99-97b9-69c7701479fd None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.804419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.805557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.806112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.806584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.813396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.815096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:06.829388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:06.830358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:06.831273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:06.834353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 469/947] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:06.842612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:06.942797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948b02-300c-4c7f-a25a-e6065a3cc947 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:06.983501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:06.984561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:06.985044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:06.985549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:06.986562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:06.987333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:06.989020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407bce3-b229-49f0-b420-bd346861101b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.001955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 479/948] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:07.010826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.116120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bc0f7-acea-491a-a80d-701d2baae552 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.133510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fef3-0b4c-42fa-affa-fb3c301051da None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.134183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fef3-0b4c-42fa-affa-fb3c301051da None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.134183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fef3-0b4c-42fa-affa-fb3c301051da None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.135616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 480/949] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:07.140776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.141295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.141802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.156621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560076b9-f579-4566-aa36-c3f21ba059d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.157498 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560076b9-f579-4566-aa36-c3f21ba059d7 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.157820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560076b9-f579-4566-aa36-c3f21ba059d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.158071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560076b9-f579-4566-aa36-c3f21ba059d7 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/51eb6844e80e49bbbbdeb0df5980acd0/roles/6b461d0b106c457ca6c4a91841818d94` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.159069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:07.160326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560076b9-f579-4566-aa36-c3f21ba059d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=51eb6844e80e49bbbbdeb0df5980acd0, role_id=6b461d0b106c457ca6c4a91841818d94)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.160721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:07.161955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560076b9-f579-4566-aa36-c3f21ba059d7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.180007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 470/950] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:44:07 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/51eb6844e80e49bbbbdeb0df5980acd0/roles/6b461d0b106c457ca6c4a91841818d94 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:44:07.214494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a264d3c-045c-4e64-adb6-5f44295915ca None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.214813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a264d3c-045c-4e64-adb6-5f44295915ca None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.215355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a264d3c-045c-4e64-adb6-5f44295915ca None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.216783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 471/951] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:07.222561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.222845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.223161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.241109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:07.242747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:07.244222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 481/952] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:07.269254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.321897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 472/953] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:07.338883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.376574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2741db-0b4a-417b-a224-8986743cd12d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.426016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.427663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.428006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.428341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.429916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.431386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:07.446716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:07.447750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:07.448674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 482/954] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:07.453940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.463707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132b206-be14-4e39-a671-da53c27f35ca None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.507664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.509202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.509657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.510372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.511175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.513113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:07.528708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:07.529777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:07.530634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:07.531388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 473/955] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:07.538701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.568417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a89d0-73ac-4e6c-9b7e-14abbe76a837 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.602501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.603531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.603997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.604455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.605365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:07.605910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.607557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.614355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 483/956] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:07.620088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.651865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe2ed9-bb05-42f0-b432-7f49d7d0a538 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.694831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.695957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.696925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.697388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.698596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:07.699092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.701730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.712604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 474/957] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:07.714116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.736211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d955d90-7d1b-4aeb-aa69-cc9f7ee57160 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.778326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.779319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.779863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.780315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.781242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:07.781781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.783378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.789252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 484/958] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:07.798514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:07.823351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52252d-67fe-4999-8bbd-2316bb48b0fb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.863417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.864331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.864985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.865324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.866373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:07.866891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.868933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585d3a8-5a50-42e1-a86d-6e7719faf799 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.874372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 475/959] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:07.920124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080dd4b-9202-474b-9a45-703107bf532a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:07.955021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245d874-3d44-408a-ba4d-8fed229bb1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:07.955692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245d874-3d44-408a-ba4d-8fed229bb1c6 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:07.955968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245d874-3d44-408a-ba4d-8fed229bb1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:07.956234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245d874-3d44-408a-ba4d-8fed229bb1c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:07.956978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245d874-3d44-408a-ba4d-8fed229bb1c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:07.958949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245d874-3d44-408a-ba4d-8fed229bb1c6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:07.982199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 485/960] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:44:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:08.764335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6994c-2f73-4636-8145-dd155a948e8a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:08.764899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6994c-2f73-4636-8145-dd155a948e8a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:08.765313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6994c-2f73-4636-8145-dd155a948e8a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:08.767072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 476/961] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:08.772601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:08.773488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:08.773997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:08.790653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:08.792092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:08.862411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 486/962] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:08.887733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6994c-2f73-4636-8145-dd155a948e8a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:08.993347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6994c-2f73-4636-8145-dd155a948e8a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:09.028817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:09.029422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.029699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.029999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.030779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:09.032222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:09.047292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.sql.core [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 16:44:09.047292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 16:44:09.047292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [parameters: {'user_id': 'fecbc4b89c98450187844460049c3797', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 16:44:09.047292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79956) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result = self._query(query) May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application conn.query(q) May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result.read() May 16 16:44:09.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 16:44:09.056362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application next(self.gen) May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application yield resource May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application next(self.gen) May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.session.rollback() May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.force_reraise() May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise self.value May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application session.commit() May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 16 16:44:09.057267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._prepare_impl() May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.session.flush() May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._flush(objects) May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application compat.raise_( May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application flush_context.execute() May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rec.execute(self) May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 16 16:44:09.058635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application _emit_insert_statements( May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result = connection._execute_20( May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ret = self._execute_context( May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 16 16:44:09.059496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self.dialect.do_execute( May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result = self._query(query) May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application conn.query(q) May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application result.read() May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 16 16:44:09.066896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application packet.raise_for_error() May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fecbc4b89c98450187844460049c3797', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:09.068888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 16 16:44:09.070766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:09.075409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 477/963] 10.222.0.70 () {60 vars in 1131 bytes} [Mon May 16 16:44:08 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:09.076323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:09.174576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe043a-1322-455c-a177-ef025a89a1d3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:09.215582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:09.216380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.216658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.216929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.224660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:09.226137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0fd8e77b-63ed-4960-86ee-8b434e2e0b5c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:09.241533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:09.242540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:09.243521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 487/964] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:09.250561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:09.356293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270db7a-eced-4743-84a1-11978b878df1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:09.389759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:09.390424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.390703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.390968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.391755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:09.392053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:09.393671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db6812-1967-4a8f-adbe-46b1462bfe36 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:09.432289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 478/965] 10.222.0.70 () {56 vars in 1101 bytes} [Mon May 16 16:44:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:09.478296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0f82-d831-477b-8e90-d75d54cdd242 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.478634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0f82-d831-477b-8e90-d75d54cdd242 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.478841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c0f82-d831-477b-8e90-d75d54cdd242 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.480498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 488/966] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:09.486347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.486629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.487166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.505539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:09.507114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:09.579116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 479/967] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:09.603122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c0f82-d831-477b-8e90-d75d54cdd242 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:09.710253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c0f82-d831-477b-8e90-d75d54cdd242 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:09.743784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:09.744593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.744864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.745129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.755578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:09.763548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:09.764453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:09.765415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:09.769575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 489/968] 10.222.0.70 () {56 vars in 1120 bytes} [Mon May 16 16:44:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:09.771482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:09.864396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaaec9-02fe-4a41-a3bd-dab2ed9431a3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:09.896618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:09.897288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:09.897548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:09.897845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:09.898589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:09.898890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:09.900268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:09.912776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 480/969] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:09.914372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.011254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7de3-ff94-4d2c-919e-5c3b5033717f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.045315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.046128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.046406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.046674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.058183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.059644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-682f2abe-4ef9-4562-a6b9-5afa42d54ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:10.076670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:10.077616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:10.079381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:10.079381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:10.079381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:10.079381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:10.079381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 490/970] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:10.083797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.185555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f492338-3f2b-4602-a67c-ba3a5697f2d6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.194012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571037e6-54ef-4380-9ede-ec1c9309a566 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.194293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571037e6-54ef-4380-9ede-ec1c9309a566 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.194560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571037e6-54ef-4380-9ede-ec1c9309a566 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.196172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 491/971] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:10.200944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.201222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.201493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.217458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:10.218820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:10.219270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.219929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.220208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.220480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.221190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:10.221494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.222975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.235601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 481/972] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:10.241844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.284789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 492/973] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:10.307746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.339110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ce071-92c4-4a88-9295-20e7d5be3aa5 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.370802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.371614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.371885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.372156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.380183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.381630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f24e2b19-a28c-4b19-8f72-3f3dca7adf57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:10.396114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:10.397066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:10.398161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 482/974] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:10.398947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d5ff8-d56f-4176-bd06-9f2992d53a0b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.398947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d5ff8-d56f-4176-bd06-9f2992d53a0b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.399083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d5ff8-d56f-4176-bd06-9f2992d53a0b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.400262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 483/975] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:10.405035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d5ff8-d56f-4176-bd06-9f2992d53a0b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.408695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81863498-ba3d-4e97-a93f-ed57fad0b2d9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.441162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fed96-f132-4c85-beef-758adf276a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.442463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fed96-f132-4c85-beef-758adf276a73 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.442744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fed96-f132-4c85-beef-758adf276a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.443017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fed96-f132-4c85-beef-758adf276a73 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.443730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fed96-f132-4c85-beef-758adf276a73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.445108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fed96-f132-4c85-beef-758adf276a73 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.457950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 493/976] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:44:10 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:44:10.459149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.459431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.459710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.476836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:10.478103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:10.519505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d5ff8-d56f-4176-bd06-9f2992d53a0b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.556476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 494/977] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:10.557083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.558048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.558505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.558998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.560126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:10.560621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.562398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.579320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.586637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 484/978] 10.222.0.70 () {56 vars in 1149 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:10.587829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.679695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e951ba-c8e1-4cf0-ae0b-60a96ddc0b06 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.689112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c3d64-56d1-4b25-bb24-463a0991c80a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.712802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.713601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.713912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.714184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.714857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.716232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.722356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.723571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.723844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.724109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:10.728488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:10.729577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:10.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:10.733890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 495/979] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:10.735556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.788984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.790500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.831065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412d0f2-48a9-40e2-aa39-3504baaa3ed1 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.865462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:10.866153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:10.866429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:10.866696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:10.867398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:10.867694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:10.869065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:10.878339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 496/980] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:10.879438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.885484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 485/981] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:44:10.891250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:10.974581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec354ff-9d81-4b0c-a946-2758a22f2621 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:10.987829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f8e0-8177-40fc-8430-6f282cf23d6a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.011623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.012535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.012812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.013082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.013795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:11.014104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.015469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.020185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 497/982] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:11.022059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.022923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.023201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.023470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.025835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:11.034341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.035850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:11.053342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:11.054452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:11.055375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:11.055375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:11.055375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:11.055375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:11.055375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 486/983] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:11.061724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:11.125226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e44475-a4e6-4c80-940c-63c1e2eafa9c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.159090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.160012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.160290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.161122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.161952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] RBAC: Adding query filter params (interface=admin, service_id=53b71ecf3f2c44dab29b214135ea28c0, region_id=RegionOne) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:11.162264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.163655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.166381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56e22a-5bfe-42ea-ac5a-0ea812a91793 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.168502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 498/984] 10.222.0.70 () {56 vars in 1249 bytes} [Mon May 16 16:44:11 2022] GET /identity/v3/endpoints?service_id=53b71ecf3f2c44dab29b214135ea28c0&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:11.173827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:11.204752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.205578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.205897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.206165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.206878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:11.207283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.209191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.224974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 487/985] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:11.226678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:11.270724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810501c-123b-481f-b5aa-675be331ec31 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.304813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.305511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.305779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.306054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.306725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.308097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.314395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 499/986] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:44:11 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:44:11.326657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4379ecb-581d-43f6-9ace-ac43d3e75ed8 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.361469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.362557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.362885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.363107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.370974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.372465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:11.387769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:11.388794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:11.395116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 488/987] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:11.395638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:11.505328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac060f1-6080-45b9-b36c-1639ac45fd51 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.538384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.539072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.539445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.539734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.540554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:11.540864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.542554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07096cdb-5dde-4e65-8c93-3de30e4add82 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.558199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 500/988] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:11.564040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:11.664899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73d7b-dae2-4833-8984-7927bfdb5995 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:11.698285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:11.698938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:11.699215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:11.699486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:11.700313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] RBAC: Adding query filter params (role.id=6b461d0b106c457ca6c4a91841818d94, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=51eb6844e80e49bbbbdeb0df5980acd0) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:11.700623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:11.702092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c12cd6-a4dd-42e0-8c35-f2ca444847e7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:11.717796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 489/989] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:11 2022] GET /identity/v3/role_assignments?user.id=51eb6844e80e49bbbbdeb0df5980acd0&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=6b461d0b106c457ca6c4a91841818d94 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:12.692530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d750e3-dcd4-4474-9566-cc63a109bcba None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:12.693028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d750e3-dcd4-4474-9566-cc63a109bcba None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:12.693028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d750e3-dcd4-4474-9566-cc63a109bcba None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:12.694507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 501/990] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:12.699629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212788-f64e-4743-974e-d76b809153ec None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:12.700050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212788-f64e-4743-974e-d76b809153ec None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:12.700191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212788-f64e-4743-974e-d76b809153ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:12.716885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1c212788-f64e-4743-974e-d76b809153ec None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:12.718071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1c212788-f64e-4743-974e-d76b809153ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:12.778977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 490/991] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:12.800786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d750e3-dcd4-4474-9566-cc63a109bcba None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:12.897555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d750e3-dcd4-4474-9566-cc63a109bcba None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:12.929178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:12.929992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:12.930268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:12.930533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:12.931175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:12.932538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:12.944439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:12.945521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:12.946730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:12.949818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 502/992] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:12.951638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212788-f64e-4743-974e-d76b809153ec None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.048170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212788-f64e-4743-974e-d76b809153ec None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:13.080932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:13.081637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.081956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.082266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.082962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:13.083260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:13.084625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:13.089941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 491/993] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:13.094908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.188904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c92ae6-2b30-4af1-9c65-b7d59b890e19 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:13.222101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:13.222695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.223001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.223272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.223964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:13.224267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:13.225636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:13.233777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 503/994] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:13.236400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.331429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caec8d-a0bc-4e33-905c-a31c57d78472 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:13.365878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:13.366557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.366836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.367109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.367917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] RBAC: Adding query filter params (interface=public, service_id=9ebc899169fd48848d440db2da586b8c, region_id=RegionOne) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:13.368228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:13.369654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a1a99-524b-4dcf-8e05-9e48cf263f72 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:13.380607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 492/995] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:44:13 2022] GET /identity/v3/endpoints?service_id=9ebc899169fd48848d440db2da586b8c&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:13.381835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.489320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e659-13fa-49b1-991f-3f62b9096439 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:13.521647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b30dc-1c0b-45bf-9391-ff818199390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:13.522335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b30dc-1c0b-45bf-9391-ff818199390c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.522614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b30dc-1c0b-45bf-9391-ff818199390c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.522886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b30dc-1c0b-45bf-9391-ff818199390c None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.523564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b30dc-1c0b-45bf-9391-ff818199390c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:13.524929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b30dc-1c0b-45bf-9391-ff818199390c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:13.531141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 504/996] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:44:13 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:44:13.548855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6a0c-ee0c-403a-99cf-99ea1032791f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.549202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6a0c-ee0c-403a-99cf-99ea1032791f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.549417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6a0c-ee0c-403a-99cf-99ea1032791f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.550973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 493/997] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:13.557490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.557819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.558077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.575933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:13.577119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:13.647442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 505/998] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:13.670124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6a0c-ee0c-403a-99cf-99ea1032791f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.772305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6a0c-ee0c-403a-99cf-99ea1032791f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:13.807938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:13.808772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.809050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.809322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.810020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:13.811427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:13.824826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:13.826202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:13.827118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 494/999] 10.222.0.70 () {56 vars in 1126 bytes} [Mon May 16 16:44:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:13.832134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.927020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e01771-99ce-4105-afe3-252de81bc0e5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:13.959895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:13.960558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.960834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.961103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.961826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:13.962130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:13.963553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1b2b0-17c4-4286-80e8-29ec8b597746 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:13.974484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 506/1000] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:13.974643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:13.978210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee1b38-4d79-4fb5-b95b-4d89b0a36123 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.978485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee1b38-4d79-4fb5-b95b-4d89b0a36123 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.978762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee1b38-4d79-4fb5-b95b-4d89b0a36123 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:13.980093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 507/1001] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:13.985007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:13.985284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:13.985553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:14.002087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:14.003262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:14.077886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 508/1002] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:14.079070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04700-c502-4020-a058-499be54d50c7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:14.093606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:14.110864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:14.111529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:14.112075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:14.112346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:14.113043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:14.113346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:14.115239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:14.124407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 495/1003] 10.222.0.70 () {56 vars in 1122 bytes} [Mon May 16 16:44:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:14.125377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:14.195875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293e73f-279c-48ef-8a86-0e28b3e5cb49 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:14.218374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7240-067a-4fdc-b4d6-357c5d2884dc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:14.229059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:14.229885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:14.230220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:14.230493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] PATH_INFO: `/v3/services/image` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:14.231140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:14.232511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:14.244879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:14.246158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:14.247241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 509/1004] 10.222.0.70 () {56 vars in 1105 bytes} [Mon May 16 16:44:14 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:14.251892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:14.254108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:14.254760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:14.255040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:14.255313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:14.256052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:14.257412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:14.273131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 496/1005] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:44:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:14.357499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5994-d711-49e8-86b6-30bd515b6d78 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:14.400974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:14.401936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:14.402362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:14.402779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:14.403644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:14.404125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:14.405728 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140fa6f-9243-46a2-aa1b-b6fe8cc131b1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:14.412015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 510/1006] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:14.417472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:14.517613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f7e9-7255-4dc8-b839-e6b739fddebb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:14.549193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:14.550071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:14.550494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:14.551441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:14.552301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:14.552750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:14.554297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e075d16-1e7a-4724-9ad6-65958b9790c2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:14.559016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 497/1007] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:15.806965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6278-7664-49a0-84d3-41a0ef4002db None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:15.807484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6278-7664-49a0-84d3-41a0ef4002db None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:15.807484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6278-7664-49a0-84d3-41a0ef4002db None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:15.808949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 511/1008] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:15.813933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:15.814318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:15.814505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:15.831333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:15.832561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:15.895975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 498/1009] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:15.918822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6278-7664-49a0-84d3-41a0ef4002db None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.014786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6278-7664-49a0-84d3-41a0ef4002db None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:16.046836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:16.047626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.047903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.048171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.048813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:16.050216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:16.062214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:16.063202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:16.064041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 512/1010] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:16.071073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.170121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087f752-930d-4a8a-898a-837d9bbe4052 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:16.201854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:16.202517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.202797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.203064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.203762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:16.204064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:16.205434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:16.215148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 499/1011] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:16.216268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.312949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327d476-3e86-4685-a82e-910dbfbf4210 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:16.344852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:16.345540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.345848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.346126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.346845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:16.347150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:16.349149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ee8d-b7e3-4be8-bbd3-6e137742098e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:16.359521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 513/1012] 10.222.0.70 () {56 vars in 1112 bytes} [Mon May 16 16:44:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:16.360908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.471392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390b8b-efe0-4363-b73f-daea2197a850 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:16.503613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d150a2-9ac9-465f-b947-d7f359106773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:16.504805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d150a2-9ac9-465f-b947-d7f359106773 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.505086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d150a2-9ac9-465f-b947-d7f359106773 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.505358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d150a2-9ac9-465f-b947-d7f359106773 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.506130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d150a2-9ac9-465f-b947-d7f359106773 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:16.507495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d150a2-9ac9-465f-b947-d7f359106773 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:16.529780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 500/1013] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:44:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:16.543352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91428-1387-44a0-8df6-dd587b3b01cb None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.543738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91428-1387-44a0-8df6-dd587b3b01cb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.544090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91428-1387-44a0-8df6-dd587b3b01cb None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.545575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 514/1014] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:16.551601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa690-5157-4fd7-a2ca-c37599c5bbe7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.551916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa690-5157-4fd7-a2ca-c37599c5bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.552161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa690-5157-4fd7-a2ca-c37599c5bbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.570447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2fafa690-5157-4fd7-a2ca-c37599c5bbe7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:16.571592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2fafa690-5157-4fd7-a2ca-c37599c5bbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:16.651598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 501/1015] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:16.675342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91428-1387-44a0-8df6-dd587b3b01cb None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.779121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed448e-2a2a-404f-b8c4-403e2c670b2e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.779437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed448e-2a2a-404f-b8c4-403e2c670b2e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.779679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed448e-2a2a-404f-b8c4-403e2c670b2e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.781247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 502/1016] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:16.782788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91428-1387-44a0-8df6-dd587b3b01cb None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:16.786420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.786700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.786972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.803679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:16.805284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:16.819582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:16.819582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.819582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.819582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.820832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:16.822291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:16.824239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 515/1017] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:16.830502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.874585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 503/1018] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:16.897478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:16.927017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579d5c0-8655-4a14-b36b-219e09b98108 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:16.960172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c30ae3-cbf0-4c85-b3f5-eaec38b32ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:16.960832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c30ae3-cbf0-4c85-b3f5-eaec38b32ef3 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:16.961107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c30ae3-cbf0-4c85-b3f5-eaec38b32ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:16.961375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c30ae3-cbf0-4c85-b3f5-eaec38b32ef3 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:16.962112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c30ae3-cbf0-4c85-b3f5-eaec38b32ef3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:16.963537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c30ae3-cbf0-4c85-b3f5-eaec38b32ef3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:16.988992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 516/1019] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:44:16 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:16.993613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b573fb1-0c9d-4edc-9b38-f876ad3188f5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:17.036120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaf2c9-15f7-4a6c-8297-55a52640da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:17.037113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf2c9-15f7-4a6c-8297-55a52640da29 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:17.037567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf2c9-15f7-4a6c-8297-55a52640da29 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:17.038075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaf2c9-15f7-4a6c-8297-55a52640da29 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:17.038978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf2c9-15f7-4a6c-8297-55a52640da29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:17.040557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaf2c9-15f7-4a6c-8297-55a52640da29 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:17.057614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 504/1020] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:44:16 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:44:18.886002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c2ef-8455-4316-955e-261b53d3eaf0 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:18.886576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c2ef-8455-4316-955e-261b53d3eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:18.886576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c2ef-8455-4316-955e-261b53d3eaf0 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:18.887888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 517/1021] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:18.893319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:18.893800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:18.893884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:18.911025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:18.912178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:18.980937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 505/1022] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:19.004451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5c2ef-8455-4316-955e-261b53d3eaf0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.118378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5c2ef-8455-4316-955e-261b53d3eaf0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.156804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45bb7c-9dfb-41b3-bc38-bfe9bf59a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.157612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45bb7c-9dfb-41b3-bc38-bfe9bf59a899 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.157930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45bb7c-9dfb-41b3-bc38-bfe9bf59a899 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.158204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45bb7c-9dfb-41b3-bc38-bfe9bf59a899 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.169783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45bb7c-9dfb-41b3-bc38-bfe9bf59a899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0e45bb7c-9dfb-41b3-bc38-bfe9bf59a899 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:19.178855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:19.179855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:19.180687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:19.188246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 518/1023] 10.222.0.70 () {56 vars in 1120 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:19.188407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.278976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015efed5-f70d-4ba0-b62a-57aa02db5a73 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.281889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe619-a8df-4070-9090-db821d7e014f None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.282178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe619-a8df-4070-9090-db821d7e014f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.282457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe619-a8df-4070-9090-db821d7e014f None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.284072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 519/1024] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:19.289003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2599cc-6818-4fc3-9b15-d15c74f1686b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.289285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2599cc-6818-4fc3-9b15-d15c74f1686b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.289555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2599cc-6818-4fc3-9b15-d15c74f1686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.307580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4a2599cc-6818-4fc3-9b15-d15c74f1686b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:19.308767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4a2599cc-6818-4fc3-9b15-d15c74f1686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:19.318349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.319020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.319299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.319572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.320320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:19.320690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.322114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.334589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 506/1025] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:19.335616 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.379984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 520/1026] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:19.381303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6423ae-122c-44f0-a42d-d5906c56755d None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.381591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6423ae-122c-44f0-a42d-d5906c56755d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.381903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6423ae-122c-44f0-a42d-d5906c56755d None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.383289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 521/1027] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:19.388345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.388628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.388903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.404533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:19.405757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:19.438027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee69b7-b286-4a69-b982-12ac5cef0023 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.469682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.470496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.470770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.471039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.477904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 522/1028] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:19.478773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.481669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.483140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:19.500499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:19.501441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:19.502558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:19.502558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:19.502558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:19.502558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:19.502558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 507/1029] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:19.502869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.575332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8697a-71e8-4063-ae24-6a21697f6b4c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.594155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ed0d5-17fd-4050-8dd0-23c1ecad246b None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.607007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.607792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.608070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.608353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.609504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.610978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.612995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 523/1030] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:19.614175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.626866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.627649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.627925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.628195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] PATH_INFO: `/v3/services/image` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.628908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.630299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:19.641391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:19.642644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:19.643528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 508/1031] 10.222.0.70 () {56 vars in 1105 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/services/image => generated 86 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:19.644332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.712053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c313-4186-4a97-9dd1-a03acb9d5cc4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.734599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190172c-38b7-49c5-b777-fec2b8413f79 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.747001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.747854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.748360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.748851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.749802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:19.750112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.751927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.765395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 524/1032] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:19.766249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.771569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.772233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.772512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.772785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.773484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.774954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.795603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 509/1033] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:44:19 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:19.796421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.892576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00724-c7a9-4d46-a162-fa67a410d633 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.902415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a4ca5-ebf0-44fc-abc3-5c2a3452f9cd None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:19.929134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.929983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.930261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.930535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.931257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] RBAC: Adding query filter params (name=image) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:19.931561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.932969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.938294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 525/1034] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:19.941322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:19.942187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:19.942466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:19.942735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:19.944429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:19.951221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:19.952700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:19.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:19.969106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:44:19.970099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:19.974089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 510/1035] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:19.975682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.048933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614afbf-4cc5-449c-877c-661f6c121d38 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.084316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.084989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.085273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.085551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.086313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] RBAC: Adding query filter params (type=image) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:20.086621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.088014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.092502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267f77-a04b-4655-87ec-4bb336909fa6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.098197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 526/1036] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:20.099840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.133018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.134165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.134446 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.134719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.135555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:20.135859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.137291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.154551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 511/1037] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:44:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:20.159865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.200802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f584e-1b44-4d96-a643-fd3537a12bf3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.233169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.233764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.234047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.234315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.235090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] RBAC: Adding query filter params (interface=public, service_id=2d767d589b2f4c0c9b6fa18c354a3446, region_id=RegionOne) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:20.235390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.237022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.242495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 527/1038] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/endpoints?service_id=2d767d589b2f4c0c9b6fa18c354a3446&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:20.247567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.255839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b55d8-1cc3-4e6c-8b99-dc30b67e4b43 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.288583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.289238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.289604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.289911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.346076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a464-791e-43df-b768-0018c363d872 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.358502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.359967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.380268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.380939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.381221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.381491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.382201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.383577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.397783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 528/1039] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:44:20.475442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 512/1040] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 16:44:20.481775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.585176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c27da1-e44b-4072-aa5b-b5904ed26e4c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.619003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.619795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.620074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.620345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.631324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.632778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:20.649274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:20.650198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:20.651100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:20.651100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:20.651100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:20.651100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:20.651100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 529/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:20.657063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.750615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e13c64-7347-43e8-bad4-e462be2d7b7e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.782896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.783554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.783835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.784108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.784821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:20.785156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.786569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.802240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 513/1042] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:20.803738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:20.898073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253dbc5-2cb4-4ea1-85ff-ac9bc0118898 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:20.929568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:20.930381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:20.930743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:20.930941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:20.937234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:20.938698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:20.953132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:20.954280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:20.955172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:20.958112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 530/1043] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:20.960557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:21.059639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc45bc-906a-4bd2-a712-cb2c4fbb8e0e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:21.092154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:21.092816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:21.093093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:21.093358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:21.094167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:21.094475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:21.095918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23a5cc-5b06-4ce8-9b4b-0644d621f7d2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:21.107734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 514/1044] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:21.113755 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:21.209328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b75c1-049a-4da9-843e-e4dad8606eba None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:21.241004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:21.241659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:21.241963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:21.242232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:21.243051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] RBAC: Adding query filter params (role.id=6b461d0b106c457ca6c4a91841818d94, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=fc0134f8e7c1401eb79c443f67174a0f) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:21.243358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:21.244793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da89-91fb-4673-b8a6-614a96292913 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:21.256978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 531/1045] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:21 2022] GET /identity/v3/role_assignments?user.id=fc0134f8e7c1401eb79c443f67174a0f&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=6b461d0b106c457ca6c4a91841818d94 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:22.079141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50bdee-cf1a-45f7-8198-ccd649206ba8 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.079676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50bdee-cf1a-45f7-8198-ccd649206ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.079676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50bdee-cf1a-45f7-8198-ccd649206ba8 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.081070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 515/1046] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:22.086750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.087153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.087343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.103851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:22.105003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:22.167500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 532/1047] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:22.189695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50bdee-cf1a-45f7-8198-ccd649206ba8 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.283869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50bdee-cf1a-45f7-8198-ccd649206ba8 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:22.315915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:22.316722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.316994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.317258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.326680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:22.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:22.335665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:22.336515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:22.344342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 516/1048] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:22.344576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.443235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c26aa-d89f-44b9-b104-298082cd358a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:22.479021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:22.479695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.479975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.480246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.480994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:22.481296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:22.482702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385d18d-42e5-4acf-9443-ae0bfe850730 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:22.495671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 533/1049] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:22.496929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.589916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de23a0-9abe-4d04-a571-0a144baa3421 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:22.620526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:22.621381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.621654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.621948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] PATH_INFO: `/v3/users/47092d88d821432294914db79efc497f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.634706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2db06-174d-4d7d-b721-2a88ebc9e44e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.635040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] RBAC: Authorizing `identity:get_user(user_id=47092d88d821432294914db79efc497f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:22.635167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2db06-174d-4d7d-b721-2a88ebc9e44e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.635408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2db06-174d-4d7d-b721-2a88ebc9e44e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.636477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:22.637215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 534/1050] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:22.638227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 517/1051] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/users/47092d88d821432294914db79efc497f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:22.644143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.644285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.645105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.645278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.661019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:22.662212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:22.726368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 535/1052] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:22.737565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c710e0-a59e-4574-a614-3483dac192ee None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:22.748972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.770249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:22.770897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.771172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.771443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.835156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:22.836726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:22.844367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a600f-01fd-445f-b788-edd35be6a707 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:22.877461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:22.878301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:22.878533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:22.879358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] PATH_INFO: `/v3/services/image` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:22.879994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:22.881414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:22.892539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:22.893528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 16 16:44:22.894756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:22.898091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 536/1053] 10.222.0.70 () {56 vars in 1105 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:22.899481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.939392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 518/1054] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 16:44:22.941019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:22.993835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a1cd9-f278-48d7-b5a2-e2bd931e19fc None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.026121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.027123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.027586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.028056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.028826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] RBAC: Adding query filter params (name=image) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:23.029132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:23.030527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:23.037511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f7ef-e4e5-4c2b-ace4-d6924ebf8ae4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.037661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 537/1055] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:23.045350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:23.075082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.075938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.076208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.076476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.077622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] RBAC: Authorizing `identity:get_project(project_id=b9be35cd4d4c4abeb321919248850352)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:23.079110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:23.086201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 519/1056] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:22 2022] GET /identity/v3/projects/b9be35cd4d4c4abeb321919248850352 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:23.087076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:23.149697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3af53-558b-4947-9869-35d35bd82e22 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.181625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a16e8-1488-4f9a-b6de-5dc91b05aca4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.181867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.182363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.182635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.182898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.183586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] RBAC: Adding query filter params (type=image) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:23.183882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:23.185239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:23.190199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 538/1057] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:23.195933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:23.216297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.216959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.217241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.217510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.218391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=b9be35cd4d4c4abeb321919248850352, user.id=47092d88d821432294914db79efc497f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:23.218690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:23.220121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000075d-f604-488d-b888-f98e1232a161 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:23.225383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 520/1058] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:23 2022] GET /identity/v3/role_assignments?user.id=47092d88d821432294914db79efc497f&scope.project.id=b9be35cd4d4c4abeb321919248850352&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:23.298939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6495515-157b-47d5-ba70-2e971bd34b01 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.335672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804690f3-c3c2-495a-8b8e-0ec182709302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.336765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804690f3-c3c2-495a-8b8e-0ec182709302 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.337306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804690f3-c3c2-495a-8b8e-0ec182709302 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.337788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804690f3-c3c2-495a-8b8e-0ec182709302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.338724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804690f3-c3c2-495a-8b8e-0ec182709302 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:23.340327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804690f3-c3c2-495a-8b8e-0ec182709302 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:23.365837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 539/1059] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:44:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:44:23.481668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc832-0fca-4de1-8da5-df21cd61c35c None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.481987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc832-0fca-4de1-8da5-df21cd61c35c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.482270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc832-0fca-4de1-8da5-df21cd61c35c None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.483666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 521/1060] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:23.490140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.490422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.490692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.508087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:23.509301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:23.584529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 540/1061] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:23.608082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bc832-0fca-4de1-8da5-df21cd61c35c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:23.704383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bc832-0fca-4de1-8da5-df21cd61c35c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.737332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.738209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.738488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.738755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.749298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:23.757443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:23.758526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:23.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 522/1062] 10.222.0.70 () {56 vars in 1120 bytes} [Mon May 16 16:44:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:23.766268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:23.858880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0020f5-b3da-4410-9b8e-b2ea4921a40f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:23.890193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:23.890851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:23.891126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:23.891393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:23.892123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:23.892421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:23.893795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:23.906657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 541/1063] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:23.908234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.002569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05055-5df9-48d8-a679-dd67292eeae4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.034310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.035189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.035464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.035729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.045709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.047188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:24.063427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:24.064375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:24.065296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:24.065296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:24.065296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:24.065296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:24.065296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 523/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:24.070891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.166611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac298d-d446-49ed-8b71-eac67f5b928e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.198178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.198831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.199108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.199379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.200084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:24.200383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.201767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:24.213653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 542/1065] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:24.218999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.312060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b6b79-50aa-4637-b61b-5ccf2cd3fe1c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.343219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.343996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.344272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.344537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] PATH_INFO: `/v3/users/nova` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.353226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.354759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:24.370360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:24.371381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:44:24.372385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:24.374092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 524/1066] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:44:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:24.377276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.477033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e9bc8-b7cb-4ccc-9a90-70d944339db2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.510831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.511502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.511783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.512056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.512903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:24.513209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.514739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:24.537793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 543/1067] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:44:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:24.538931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.633005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb864ca5-c6aa-4eaa-b1b3-9fe6e1aa6aae None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.664625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.665666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.666220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.666669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.677320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.679130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:24.696212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:24.697196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:24.698144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:24.698144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:24.698144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:24.698144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:24.699230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 525/1068] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:24.704580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.801351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c715f9-ab12-4b33-9839-2a3d46cd6cb0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.832742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.833397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.833674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.833985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.834695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:24.835000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.836382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:24.852099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 544/1069] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:24.853288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:24.949160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5fe6-c04e-4795-b4ce-5f9652e01efb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:24.980899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:24.981681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:24.981978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:24.982244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:24.988932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:24.990391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:25.004615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:25.005491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:25.006821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:25.007620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 526/1070] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:25.011515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:25.108926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c6bd-3095-4639-9643-b2a581177cf2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:25.142967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:25.143627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.143901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.144170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.144984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:25.145287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:25.146811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bc33b-3c8f-4d97-a4f6-d37282640c8b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:25.163185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 545/1071] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:25.164351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:25.257933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7d00-952e-431c-8c4f-5e276b21d1c8 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:25.291504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced75ad0-c23e-4fea-9532-fcf79fa190b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:25.292408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75ad0-c23e-4fea-9532-fcf79fa190b3 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.292685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75ad0-c23e-4fea-9532-fcf79fa190b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.292955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced75ad0-c23e-4fea-9532-fcf79fa190b3 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/fc0134f8e7c1401eb79c443f67174a0f/roles/6b461d0b106c457ca6c4a91841818d94` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.295347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced75ad0-c23e-4fea-9532-fcf79fa190b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=fc0134f8e7c1401eb79c443f67174a0f, role_id=6b461d0b106c457ca6c4a91841818d94)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:25.296924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced75ad0-c23e-4fea-9532-fcf79fa190b3 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:25.321769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 527/1072] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:44:25 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/fc0134f8e7c1401eb79c443f67174a0f/roles/6b461d0b106c457ca6c4a91841818d94 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:44:25.475816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cbc67-2dec-4b7f-91ec-1d35cea4998c None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.476411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cbc67-2dec-4b7f-91ec-1d35cea4998c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.476411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cbc67-2dec-4b7f-91ec-1d35cea4998c None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.478077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 546/1073] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:25.483896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e43a4-5bec-4776-8b90-2787b7ce29e6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.484205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e43a4-5bec-4776-8b90-2787b7ce29e6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.484441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e43a4-5bec-4776-8b90-2787b7ce29e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.509948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ee3e43a4-5bec-4776-8b90-2787b7ce29e6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:25.511078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ee3e43a4-5bec-4776-8b90-2787b7ce29e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:25.576712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 528/1074] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:25.598973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cbc67-2dec-4b7f-91ec-1d35cea4998c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:25.664480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afd6b-8c3b-4e0a-af68-3552b88cecd2 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.664772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afd6b-8c3b-4e0a-af68-3552b88cecd2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.665048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2afd6b-8c3b-4e0a-af68-3552b88cecd2 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.666577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 529/1075] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:25.671391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.671674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.671951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.687870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:25.689055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:25.698865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cbc67-2dec-4b7f-91ec-1d35cea4998c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:25.735259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:25.736284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.736999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.737419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.747703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:25.754339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 530/1076] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:25.756319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:25.757446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:25.758521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:25.760897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 547/1077] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:25.766738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:25.776884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:25.868630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736928f-8f16-4623-bf3a-610056ee2992 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:25.874995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc167d-f160-42c6-879f-a19c23de7bff None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:25.901080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:25.901761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.902045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.902317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.903050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:25.903352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:25.904732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:25.908095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:25.908730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:25.909006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:25.909279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:25.912581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 531/1078] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:25.918207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:25.979836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:25.981293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:26.020994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823201-47f2-4e6b-9a2a-18bde81213d9 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:26.052507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:26.053419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:26.053700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:26.054000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] PATH_INFO: `/v3/users/47092d88d821432294914db79efc497f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:26.055221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] RBAC: Authorizing `identity:get_user(user_id=47092d88d821432294914db79efc497f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:26.056650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:26.065190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 532/1079] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:25 2022] GET /identity/v3/users/47092d88d821432294914db79efc497f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:26.065190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:26.082982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 548/1080] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 16:44:26.084082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:26.160215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99f44a-b550-4908-87a7-1dfd8ae50824 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:26.185081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be531-b076-425e-85f9-6223fb1ad076 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:26.192882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:26.193730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:26.194030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:26.194298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:26.195462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b9be35cd4d4c4abeb321919248850352)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:26.196891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:26.198810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 533/1081] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:26 2022] GET /identity/v3/projects/b9be35cd4d4c4abeb321919248850352 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:26.204230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:26.218401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:26.219181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:26.219457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:26.219726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:26.229851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:26.231299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:26.251478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:26.252381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:26.253266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:26.253266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:26.253266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:26.253266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:26.257540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 549/1082] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:26.258383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:26.300090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f131-f439-424e-85c6-e2bbcf2ec5c2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:26.332530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22c3ee-fbf5-4b38-996a-ee848b372331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:26.333405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c3ee-fbf5-4b38-996a-ee848b372331 None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:26.333686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c3ee-fbf5-4b38-996a-ee848b372331 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:26.333978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22c3ee-fbf5-4b38-996a-ee848b372331 None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352/users/47092d88d821432294914db79efc497f/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:26.335932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c3ee-fbf5-4b38-996a-ee848b372331 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9be35cd4d4c4abeb321919248850352, user_id=47092d88d821432294914db79efc497f, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:26.337352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22c3ee-fbf5-4b38-996a-ee848b372331 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:26.361772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 534/1083] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:44:26 2022] PUT /identity/v3/projects/b9be35cd4d4c4abeb321919248850352/users/47092d88d821432294914db79efc497f/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:44:26.361985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d4376-c89c-4967-a9f3-0f2df0453acc None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:26.396146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:26.396820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:26.397096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:26.397361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:26.398121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:26.398423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:26.399837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a974ae-cdc2-4035-83ff-0c180c7db32f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:26.413466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 550/1084] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:27.546228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee066-9ffa-4ca6-b968-f247f6114bca None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:27.546743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee066-9ffa-4ca6-b968-f247f6114bca None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:27.546830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee066-9ffa-4ca6-b968-f247f6114bca None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:27.548125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 535/1085] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:27.554345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:27.554756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:27.554894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:27.571675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:27.572832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:27.634975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 551/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:27.657850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee066-9ffa-4ca6-b968-f247f6114bca None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:27.751252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee066-9ffa-4ca6-b968-f247f6114bca None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:27.781534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:27.782371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:27.782646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:27.782910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:27.792895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:27.801469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:27.802453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:27.803305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 536/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Mon May 16 16:44:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:27.808606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:27.898952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553928-d1eb-4fcf-8c16-b72fe3abbe60 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:27.930795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:27.931445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:27.931720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:27.931987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:27.932717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:27.933017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:27.934409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:27.946511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 552/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:27.947680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.040164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea50cc-e104-4f64-8810-c8225cad1069 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.071229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:28.072004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.072275 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.072538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.083952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:28.085405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:28.102944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:28.104073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:28.105026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:28.105026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:28.105026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:28.105026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:28.105026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 537/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:28.110913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.204041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626be7-8393-4a1d-ad53-83e583fe5c61 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.237126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:28.237807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.238111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.238381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.239089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:28.239391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:28.240763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:28.251916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 553/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:28.258114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.359475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003c2c7-0a8b-4a69-968f-04fda4440846 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.391199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:28.391977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.392253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.392520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.400212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:28.401662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:44:28.417011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:28.418081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:28.419488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 538/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:28.423911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.524392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe995fb-d6c5-4f4e-a71f-f26c1e2ad81b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.556425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:28.557068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.557341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.557607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.558450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:28.558750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:28.560163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e508e0-6c1d-4e2c-8fff-7961b07675fa None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:28.577355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 554/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:28.583589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.677070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8174-c7dd-4c88-90e0-34a25519b6eb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.682862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27743-be48-4de0-a5f3-d11499f3577e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.683146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27743-be48-4de0-a5f3-d11499f3577e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.683418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc27743-be48-4de0-a5f3-d11499f3577e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.688040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 555/1093] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:44:28.693777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.694063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.694487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.709266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:28.709950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.710226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.710552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.714865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:28.716192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:28.772788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:28.774264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:28.793947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 556/1094] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:28.821097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.866511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 539/1095] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:44:28.872733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:28.926378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71675ebb-0d2a-44f9-b731-671f19b4811b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.958218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:28.958937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:28.959216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:28.959489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:28.966776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0832c42-a9f2-4383-bd5e-6642d271ad28 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:28.969046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:28.977137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:28.978218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:28.979161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 557/1096] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:28.984306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.001218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.002050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.002323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.002587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.011989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.013428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:29.030168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:29.031059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:29.031967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:44:29.031967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:29.031967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:44:29.031967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:29.031967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 540/1097] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:29.037386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.077408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc65060-8ab3-457b-ac41-c8d23f7c3380 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.109964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.110621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.110899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.111170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.112179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:29.112485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.113943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.121600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 558/1098] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:29.127329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.130884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544a2b3-ec01-454d-91eb-59bdf693b439 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.162823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.163475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.163749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.164017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.164714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:29.165011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.166464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.177110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 541/1099] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:29.182951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.225314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b5ec-6254-4335-9d0e-6d12ed8e6d9b None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.257163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.258052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.258338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.258604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] PATH_INFO: `/v3/users/47092d88d821432294914db79efc497f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.259787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] RBAC: Authorizing `identity:get_user(user_id=47092d88d821432294914db79efc497f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.261227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.262875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 559/1100] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/users/47092d88d821432294914db79efc497f => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:29.268614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.284434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a56a-c421-4522-bdb6-acdc7b2f8a4c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.315600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.316928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.317202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.317472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.323822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.325258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:44:29.339433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:29.340398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:29.341289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 542/1101] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:44:29.346309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.363021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3b07-fe52-4e6c-88bd-d52d3bdb4426 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.395038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.395672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.395951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.396221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.437397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0e4a7-adf5-4795-b383-38542b6f72cb None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.460223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.461670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.469720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.470395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.470671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.470948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.471716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:29.472019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.473455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.484592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 543/1102] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:29.490527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.562511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 560/1103] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 16:44:29.563718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.582424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f289-7a83-4efe-8a8c-d17e0700d15d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.613521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129f87-346b-4727-8929-ff9af132098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.614276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129f87-346b-4727-8929-ff9af132098d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.614458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129f87-346b-4727-8929-ff9af132098d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.614724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129f87-346b-4727-8929-ff9af132098d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.615535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129f87-346b-4727-8929-ff9af132098d None admin] RBAC: Adding query filter params (role.id=6b461d0b106c457ca6c4a91841818d94, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=fc0134f8e7c1401eb79c443f67174a0f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:29.615836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129f87-346b-4727-8929-ff9af132098d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.617260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97129f87-346b-4727-8929-ff9af132098d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.622806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 544/1104] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/role_assignments?user.id=fc0134f8e7c1401eb79c443f67174a0f&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=6b461d0b106c457ca6c4a91841818d94 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:29.657977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33d32-750b-48c5-a8f1-02b2af83b742 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.693670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ec2db-bc4c-45d6-8eb6-2c50bb1327b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.694564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec2db-bc4c-45d6-8eb6-2c50bb1327b3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.694842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec2db-bc4c-45d6-8eb6-2c50bb1327b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.695116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec2db-bc4c-45d6-8eb6-2c50bb1327b3 None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.696314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ec2db-bc4c-45d6-8eb6-2c50bb1327b3 None admin] RBAC: Authorizing `identity:get_project(project_id=b9be35cd4d4c4abeb321919248850352)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.697816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ec2db-bc4c-45d6-8eb6-2c50bb1327b3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.699594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 561/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/projects/b9be35cd4d4c4abeb321919248850352 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:29.705903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129f87-346b-4727-8929-ff9af132098d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:29.806577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129f87-346b-4727-8929-ff9af132098d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:29.839230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:29.839873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:29.840150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:29.840425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:29.841281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=b9be35cd4d4c4abeb321919248850352, user.id=47092d88d821432294914db79efc497f) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:29.841595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:29.843124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb708-f5c2-4d02-8902-ad6a350f7d4a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:29.849099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 545/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:29 2022] GET /identity/v3/role_assignments?user.id=47092d88d821432294914db79efc497f&scope.project.id=b9be35cd4d4c4abeb321919248850352&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:32.108297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261473a3-798b-4503-aede-52525aac0d6c None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:32.108935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261473a3-798b-4503-aede-52525aac0d6c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:32.108935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261473a3-798b-4503-aede-52525aac0d6c None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:32.110335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 562/1107] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:32.115728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c025-872e-4318-ac62-484373392c0b None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:32.116176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c025-872e-4318-ac62-484373392c0b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:32.116281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c025-872e-4318-ac62-484373392c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:32.132171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b914c025-872e-4318-ac62-484373392c0b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:32.133339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b914c025-872e-4318-ac62-484373392c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:32.194427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 546/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:32.218549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261473a3-798b-4503-aede-52525aac0d6c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:32.312433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261473a3-798b-4503-aede-52525aac0d6c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:32.344153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc7b61-fae6-4684-98e4-05540de86a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:32.344915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7b61-fae6-4684-98e4-05540de86a42 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:32.345190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7b61-fae6-4684-98e4-05540de86a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:32.345458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc7b61-fae6-4684-98e4-05540de86a42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:32.346634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc7b61-fae6-4684-98e4-05540de86a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:32.348084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc7b61-fae6-4684-98e4-05540de86a42 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:32.349656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 563/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:32.355313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c025-872e-4318-ac62-484373392c0b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:32.446558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c025-872e-4318-ac62-484373392c0b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:32.477916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e95d1-61e4-4800-9dcc-f4a0a5ab030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:32.478570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e95d1-61e4-4800-9dcc-f4a0a5ab030e None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:32.478847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e95d1-61e4-4800-9dcc-f4a0a5ab030e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:32.479117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e95d1-61e4-4800-9dcc-f4a0a5ab030e None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:32.479806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e95d1-61e4-4800-9dcc-f4a0a5ab030e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:32.481226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e95d1-61e4-4800-9dcc-f4a0a5ab030e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:32.500005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 547/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:44:32 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:34.753870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dee9b-4893-444e-8b5d-0ca4b183fe25 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:34.754394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dee9b-4893-444e-8b5d-0ca4b183fe25 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:34.754394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dee9b-4893-444e-8b5d-0ca4b183fe25 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:34.755691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 564/1111] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:34.760816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:34.761240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:34.761369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:34.778634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:34.779812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:34.841751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 548/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:34.865598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dee9b-4893-444e-8b5d-0ca4b183fe25 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:34.982966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dee9b-4893-444e-8b5d-0ca4b183fe25 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:35.014096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:35.014876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:35.015150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:35.015416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] PATH_INFO: `/v3/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:35.016859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] RBAC: Authorizing `identity:get_role(role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:35.018258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:35.020117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 565/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:34 2022] GET /identity/v3/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:35.025932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:35.119638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa957fb6-4b13-437d-9bd1-6aaabe29e865 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:35.150584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:35.151436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:35.151711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:35.151980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] PATH_INFO: `/v3/users/fa4f0990b3f6455cbe85da9fcf40969d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:35.164517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] RBAC: Authorizing `identity:get_user(user_id=fa4f0990b3f6455cbe85da9fcf40969d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:35.165992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:35.167610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 549/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:35 2022] GET /identity/v3/users/fa4f0990b3f6455cbe85da9fcf40969d => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:35.173233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:35.268690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ff116-d928-4f1c-9e93-63fa50f3e767 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:35.301688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:35.302361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:35.302637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:35.302905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:35.365552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:35.367032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:35.458402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 566/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:44:35.464256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:35.556157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567304e8-e914-4c33-b8d3-9b07a77af245 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:35.597938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751faba-f43b-4cfd-bfa7-93c618c4c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:35.600513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751faba-f43b-4cfd-bfa7-93c618c4c1bc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:35.600784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751faba-f43b-4cfd-bfa7-93c618c4c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:35.601051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751faba-f43b-4cfd-bfa7-93c618c4c1bc None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:35.602272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751faba-f43b-4cfd-bfa7-93c618c4c1bc None admin] RBAC: Authorizing `identity:get_project(project_id=b9be35cd4d4c4abeb321919248850352)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:35.603699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751faba-f43b-4cfd-bfa7-93c618c4c1bc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:35.605400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 550/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:35 2022] GET /identity/v3/projects/b9be35cd4d4c4abeb321919248850352 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:35.611865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:35.704396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7041e-31b1-4679-af69-392a91df9bc7 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:35.735220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:35.735853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:35.736130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:35.736656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:35.737471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] RBAC: Adding query filter params (role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=b9be35cd4d4c4abeb321919248850352, user.id=fa4f0990b3f6455cbe85da9fcf40969d) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:35.738314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:35.739734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75b0b-a699-435f-819c-14d90c6b375c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:35.744865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 567/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:35 2022] GET /identity/v3/role_assignments?user.id=fa4f0990b3f6455cbe85da9fcf40969d&scope.project.id=b9be35cd4d4c4abeb321919248850352&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:37.931758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0325f1-6a39-4db5-ba23-2d57bfc84255 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:37.932289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0325f1-6a39-4db5-ba23-2d57bfc84255 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:37.932289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0325f1-6a39-4db5-ba23-2d57bfc84255 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:37.933659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 551/1118] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:37.938810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:37.939243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:37.939351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:37.955528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:37.957231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:38.018333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 568/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:38.041322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0325f1-6a39-4db5-ba23-2d57bfc84255 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:38.135828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0325f1-6a39-4db5-ba23-2d57bfc84255 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:38.167257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:38.168079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:38.168356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:38.168628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] PATH_INFO: `/v3/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:38.170098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] RBAC: Authorizing `identity:get_role(role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:38.171471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:38.172791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 552/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:38 2022] GET /identity/v3/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:38.178423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:38.270734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7e95c-f540-41ff-b9d5-d0b1e2d33375 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:38.301890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:38.302732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:38.303010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:38.303281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] PATH_INFO: `/v3/users/fa4f0990b3f6455cbe85da9fcf40969d` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:38.304452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=fa4f0990b3f6455cbe85da9fcf40969d)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:38.305906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:38.307489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 569/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:38 2022] GET /identity/v3/users/fa4f0990b3f6455cbe85da9fcf40969d => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:38.313067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:38.403482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa817bb5-d2ee-47fb-8497-fdae4098cb60 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:38.434257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213335d-07c9-477a-ade1-0fd75515900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:38.435094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213335d-07c9-477a-ade1-0fd75515900f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:38.435366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213335d-07c9-477a-ade1-0fd75515900f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:38.435633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213335d-07c9-477a-ade1-0fd75515900f None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:38.436763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213335d-07c9-477a-ade1-0fd75515900f None admin] RBAC: Authorizing `identity:get_project(project_id=b9be35cd4d4c4abeb321919248850352)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:38.438236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213335d-07c9-477a-ade1-0fd75515900f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:38.439890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 553/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:38 2022] GET /identity/v3/projects/b9be35cd4d4c4abeb321919248850352 => generated 311 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:38.446154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:38.538124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae842d-9522-4fdd-934a-24e631a20eb8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:38.570490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde75472-f17f-4f5c-8281-5057462cfb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:38.571343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75472-f17f-4f5c-8281-5057462cfb25 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:38.571617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75472-f17f-4f5c-8281-5057462cfb25 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:38.571886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde75472-f17f-4f5c-8281-5057462cfb25 None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352/users/fa4f0990b3f6455cbe85da9fcf40969d/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:38.574135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75472-f17f-4f5c-8281-5057462cfb25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9be35cd4d4c4abeb321919248850352, user_id=fa4f0990b3f6455cbe85da9fcf40969d, role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:38.575550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde75472-f17f-4f5c-8281-5057462cfb25 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:38.587539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 570/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:44:38 2022] PUT /identity/v3/projects/b9be35cd4d4c4abeb321919248850352/users/fa4f0990b3f6455cbe85da9fcf40969d/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:44:40.758248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0256e0-6894-4dff-9fac-030579ef7d44 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:40.758772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0256e0-6894-4dff-9fac-030579ef7d44 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:40.758772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0256e0-6894-4dff-9fac-030579ef7d44 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:40.760059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 554/1124] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:40.765212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988d96-3b33-4639-87f8-02772439838c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:40.765613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988d96-3b33-4639-87f8-02772439838c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:40.765777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988d96-3b33-4639-87f8-02772439838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:40.781724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d5988d96-3b33-4639-87f8-02772439838c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:40.782907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d5988d96-3b33-4639-87f8-02772439838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:40.844771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 571/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:40.868250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0256e0-6894-4dff-9fac-030579ef7d44 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:40.960221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0256e0-6894-4dff-9fac-030579ef7d44 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:40.991172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:40.991993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:40.992270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:40.992532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] PATH_INFO: `/v3/roles/eb23ec62390f47a1bc9d7987f1360f3a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:40.994023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] RBAC: Authorizing `identity:get_role(role_id=eb23ec62390f47a1bc9d7987f1360f3a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:40.995384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:40.996723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 555/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:40 2022] GET /identity/v3/roles/eb23ec62390f47a1bc9d7987f1360f3a => generated 223 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:41.002450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988d96-3b33-4639-87f8-02772439838c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:41.093311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988d96-3b33-4639-87f8-02772439838c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:41.126774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:41.127616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:41.127888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:41.128703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] PATH_INFO: `/v3/users/fa4f0990b3f6455cbe85da9fcf40969d` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:41.129903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] RBAC: Authorizing `identity:get_user(user_id=fa4f0990b3f6455cbe85da9fcf40969d)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:41.131326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:41.132912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 572/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:41 2022] GET /identity/v3/users/fa4f0990b3f6455cbe85da9fcf40969d => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:41.138685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:41.229440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c296-abca-486d-b52a-2bf5de80cd13 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:41.260710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:41.261325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:41.261596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:41.261887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:41.323444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:41.324871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:41.414848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 556/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:44:41.420596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:41.511911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee94c5-d477-419d-846f-ec8a96392225 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:41.543209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de315f3e-a9ae-4bd8-9399-f4e34ff00eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:41.544042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315f3e-a9ae-4bd8-9399-f4e34ff00eae None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:41.544318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315f3e-a9ae-4bd8-9399-f4e34ff00eae None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:41.544592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de315f3e-a9ae-4bd8-9399-f4e34ff00eae None admin] PATH_INFO: `/v3/projects/b9be35cd4d4c4abeb321919248850352` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:41.545775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315f3e-a9ae-4bd8-9399-f4e34ff00eae None admin] RBAC: Authorizing `identity:get_project(project_id=b9be35cd4d4c4abeb321919248850352)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:41.547206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de315f3e-a9ae-4bd8-9399-f4e34ff00eae None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:41.548873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 573/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:41 2022] GET /identity/v3/projects/b9be35cd4d4c4abeb321919248850352 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:41.555306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:41.647014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae839432-79af-45be-91d7-2fdca0aee91f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:41.679145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:41.679715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:41.679988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:41.680253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:41.681058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] RBAC: Adding query filter params (role.id=eb23ec62390f47a1bc9d7987f1360f3a, scope.project.id=b9be35cd4d4c4abeb321919248850352, user.id=fa4f0990b3f6455cbe85da9fcf40969d) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:41.681358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:41.682798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee55df-0a46-41be-844f-bf57a50d6999 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:41.688311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 557/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:41 2022] GET /identity/v3/role_assignments?user.id=fa4f0990b3f6455cbe85da9fcf40969d&scope.project.id=b9be35cd4d4c4abeb321919248850352&role.id=eb23ec62390f47a1bc9d7987f1360f3a => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:43.911837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcab11a-57da-41db-94bc-46a77a2f98ec None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:43.912360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcab11a-57da-41db-94bc-46a77a2f98ec None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:43.912360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcab11a-57da-41db-94bc-46a77a2f98ec None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:43.913765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 574/1131] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:43.919019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:43.919450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:43.919586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:43.935846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:43.936998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:43.997618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 558/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:44.020783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcab11a-57da-41db-94bc-46a77a2f98ec None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:44.116382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcab11a-57da-41db-94bc-46a77a2f98ec None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:44.147875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607bd92-8a1e-4660-94c1-3e3e2a414b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:44.148647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607bd92-8a1e-4660-94c1-3e3e2a414b3a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:44.148927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607bd92-8a1e-4660-94c1-3e3e2a414b3a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:44.149198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607bd92-8a1e-4660-94c1-3e3e2a414b3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:44.150367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607bd92-8a1e-4660-94c1-3e3e2a414b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:44.151786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607bd92-8a1e-4660-94c1-3e3e2a414b3a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:44.153347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 575/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:44.158977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:44.249244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414591b8-97d0-42c8-8b23-d49c4f95b778 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:44.279358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5fbe3-327e-4ac0-b63d-d5c44e9e9a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:44.279990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5fbe3-327e-4ac0-b63d-d5c44e9e9a69 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:44.280264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5fbe3-327e-4ac0-b63d-d5c44e9e9a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:44.280530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5fbe3-327e-4ac0-b63d-d5c44e9e9a69 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:44.281210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5fbe3-327e-4ac0-b63d-d5c44e9e9a69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:44.282649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5fbe3-327e-4ac0-b63d-d5c44e9e9a69 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:44.306990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 559/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:44:44 2022] POST /identity/v3/projects => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:46.526218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458944-2338-455b-bdc8-45a089a1dfd2 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:46.526722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458944-2338-455b-bdc8-45a089a1dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:46.526722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458944-2338-455b-bdc8-45a089a1dfd2 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:46.528086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 576/1135] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:46.533328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:46.533772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:46.533920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:46.550025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:46.551198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:46.612745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 560/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:46.637035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458944-2338-455b-bdc8-45a089a1dfd2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:46.731109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458944-2338-455b-bdc8-45a089a1dfd2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:46.762199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923ea3-103d-4600-b02a-7580ed8ad751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:46.762964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923ea3-103d-4600-b02a-7580ed8ad751 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:46.763234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923ea3-103d-4600-b02a-7580ed8ad751 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:46.763498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923ea3-103d-4600-b02a-7580ed8ad751 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:46.764632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923ea3-103d-4600-b02a-7580ed8ad751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:46.766079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923ea3-103d-4600-b02a-7580ed8ad751 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:46.767639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 577/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:46.773984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:46.864440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ba85a-c8f2-4a89-978a-614c00aa0f91 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:46.895583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1efe61-b724-488f-b87c-243513cf857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:46.896232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efe61-b724-488f-b87c-243513cf857f None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:46.896512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efe61-b724-488f-b87c-243513cf857f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:46.896784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1efe61-b724-488f-b87c-243513cf857f None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:46.897472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1efe61-b724-488f-b87c-243513cf857f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:46.898931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1efe61-b724-488f-b87c-243513cf857f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:46.917359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 561/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:44:46 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:44:49.166475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb6d6-d991-4994-9d6e-bf69d05062ec None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:49.167057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb6d6-d991-4994-9d6e-bf69d05062ec None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:49.167057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb6d6-d991-4994-9d6e-bf69d05062ec None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:49.168369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 578/1139] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:49.173709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:49.174164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:49.174288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:49.191352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:49.192515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:49.253916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 562/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:49.276385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb6d6-d991-4994-9d6e-bf69d05062ec None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:49.376189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb6d6-d991-4994-9d6e-bf69d05062ec None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:49.408340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:49.409130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:49.409409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:49.409680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:49.419551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:49.427432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:49.428587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:49.429679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 579/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:49.434755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:49.525121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8ecb1-ba12-45e6-9661-e457f928b794 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:49.557103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:49.557765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:49.558048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:49.558335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:49.559062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:49.559362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:49.560729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:49.568149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 563/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:44:49.573708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:49.671102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4b07-cf62-4e69-97c5-aa25650b8482 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:49.702255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:49.703110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:49.703391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:49.703662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] PATH_INFO: `/v3/users/8a2d77d595674b97b125721bd1757063` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:49.715853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] RBAC: Authorizing `identity:get_user(user_id=8a2d77d595674b97b125721bd1757063)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:49.717301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:49.718952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 580/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:49 2022] GET /identity/v3/users/8a2d77d595674b97b125721bd1757063 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:49.725254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:49.817115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f029d9c-8aff-4ce0-a2a4-140b60b2b2ad None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:49.848478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:49.849107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:49.849383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:49.849650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:49.910682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:49.912105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:50.009357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 564/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:44:50.015242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:50.107392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c06324-a7d1-409b-ae26-0e038075da71 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:50.138876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b5176-e853-47b4-b214-59761f37a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:50.139705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5176-e853-47b4-b214-59761f37a5aa None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:50.139981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5176-e853-47b4-b214-59761f37a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:50.140251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5176-e853-47b4-b214-59761f37a5aa None admin] PATH_INFO: `/v3/projects/e751285bee2b418396acf661808ccc30` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:50.141406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b5176-e853-47b4-b214-59761f37a5aa None admin] RBAC: Authorizing `identity:get_project(project_id=e751285bee2b418396acf661808ccc30)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:50.142862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b5176-e853-47b4-b214-59761f37a5aa None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:50.145056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 581/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:50 2022] GET /identity/v3/projects/e751285bee2b418396acf661808ccc30 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:50.151096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:50.241980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1395edc-cdfc-4af7-a897-1c0799b2307a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:50.273654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:50.274257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:50.274533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:50.274809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:50.275617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=e751285bee2b418396acf661808ccc30, user.id=8a2d77d595674b97b125721bd1757063) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:50.275923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:50.277329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2f78a-09f7-4971-8008-5f8d85d5c226 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:50.282442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 565/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:50 2022] GET /identity/v3/role_assignments?user.id=8a2d77d595674b97b125721bd1757063&scope.project.id=e751285bee2b418396acf661808ccc30&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:52.508708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe946-d667-41b3-8c6e-557757d7e35c None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:52.509184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe946-d667-41b3-8c6e-557757d7e35c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:52.509291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe946-d667-41b3-8c6e-557757d7e35c None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:52.510609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 582/1147] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:52.515705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:52.516155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:52.516248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:52.532796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:52.533987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:52.594917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 566/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:44:52.616795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabe946-d667-41b3-8c6e-557757d7e35c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:52.710280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabe946-d667-41b3-8c6e-557757d7e35c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:52.740849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:52.741600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:52.741902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:52.742172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:52.751455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:52.759375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:52.760453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:52.761702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 583/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:52.766189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:52.858005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1404791-ceb3-4d0e-8602-fc28db284d78 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:52.890413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:52.891066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:52.891344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:52.891615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:52.892347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:52.892653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:52.894573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:52.902194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 567/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:52.907897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:52.999676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfaec8-3f31-40b3-aa40-1c6388f22fd2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:53.030131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:53.030965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:53.031235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:53.031498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] PATH_INFO: `/v3/users/8a2d77d595674b97b125721bd1757063` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:53.032639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] RBAC: Authorizing `identity:get_user(user_id=8a2d77d595674b97b125721bd1757063)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:53.034099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:53.035665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 584/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:52 2022] GET /identity/v3/users/8a2d77d595674b97b125721bd1757063 => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:53.041009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:53.133299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a200-1a4e-403e-98f6-e9a17e2e603e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:53.163815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fd8bd-7e7a-4c66-a19c-9b2e91ed3cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:53.164647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd8bd-7e7a-4c66-a19c-9b2e91ed3cf6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:53.164923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd8bd-7e7a-4c66-a19c-9b2e91ed3cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:53.166160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fd8bd-7e7a-4c66-a19c-9b2e91ed3cf6 None admin] PATH_INFO: `/v3/projects/e751285bee2b418396acf661808ccc30` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:53.166405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fd8bd-7e7a-4c66-a19c-9b2e91ed3cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=e751285bee2b418396acf661808ccc30)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:53.167849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fd8bd-7e7a-4c66-a19c-9b2e91ed3cf6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:53.169509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 568/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:53 2022] GET /identity/v3/projects/e751285bee2b418396acf661808ccc30 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:53.175809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:53.268465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5c63-dabd-4d64-be57-2b42db52ac98 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:53.298956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f712-c89b-4c08-b896-413326a9014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:53.300356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f712-c89b-4c08-b896-413326a9014b None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:53.300628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f712-c89b-4c08-b896-413326a9014b None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:53.300896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f712-c89b-4c08-b896-413326a9014b None admin] PATH_INFO: `/v3/projects/e751285bee2b418396acf661808ccc30/users/8a2d77d595674b97b125721bd1757063/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:53.302814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f712-c89b-4c08-b896-413326a9014b None admin] RBAC: Authorizing `identity:create_grant(project_id=e751285bee2b418396acf661808ccc30, user_id=8a2d77d595674b97b125721bd1757063, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:53.304226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f712-c89b-4c08-b896-413326a9014b None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:53.316440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 585/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:44:53 2022] PUT /identity/v3/projects/e751285bee2b418396acf661808ccc30/users/8a2d77d595674b97b125721bd1757063/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:44:55.489053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cf36b-cd05-49cc-a76d-ae8dd1c19e64 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:55.489530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cf36b-cd05-49cc-a76d-ae8dd1c19e64 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:55.489617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cf36b-cd05-49cc-a76d-ae8dd1c19e64 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:55.490981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 569/1154] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:55.496057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:55.496505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:55.496606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:55.513132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:55.514315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:55.575899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 586/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:55.599190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cf36b-cd05-49cc-a76d-ae8dd1c19e64 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:55.693214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cf36b-cd05-49cc-a76d-ae8dd1c19e64 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:55.724243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:55.725019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:55.725294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:55.725564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:55.734957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:44:55.742723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:55.743803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:44:55.744868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 570/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:55.749597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:55.840330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c6541-cddc-4f9a-8af5-bf78af31d958 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:55.871883 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:55.872534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:55.872809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:55.873078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:55.873832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:55.874135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:55.875492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:55.883653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 587/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:55.889477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:55.980948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfaec-6266-4fbe-b1e2-5df21b57d35f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:56.012736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:56.013579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:56.013909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:56.014183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] PATH_INFO: `/v3/users/8a2d77d595674b97b125721bd1757063` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:56.015375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] RBAC: Authorizing `identity:get_user(user_id=8a2d77d595674b97b125721bd1757063)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:56.016796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:56.018420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 571/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:44:55 2022] GET /identity/v3/users/8a2d77d595674b97b125721bd1757063 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:56.024035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:56.116295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad194a-95b7-47b4-bd52-b72de8614060 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:56.146960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:56.147579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:56.147856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:56.148125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:56.210183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:56.211619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:56.301883 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 588/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 16 16:44:56.307554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:56.400920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed29551-bfe6-4302-85ad-82852d022472 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:56.432692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74062e54-b238-49f1-8b99-2ab4b867a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:56.433573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062e54-b238-49f1-8b99-2ab4b867a48c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:56.433860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062e54-b238-49f1-8b99-2ab4b867a48c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:56.434136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74062e54-b238-49f1-8b99-2ab4b867a48c None admin] PATH_INFO: `/v3/projects/e751285bee2b418396acf661808ccc30` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:56.435306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062e54-b238-49f1-8b99-2ab4b867a48c None admin] RBAC: Authorizing `identity:get_project(project_id=e751285bee2b418396acf661808ccc30)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:56.436747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74062e54-b238-49f1-8b99-2ab4b867a48c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:56.438479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 572/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:44:56 2022] GET /identity/v3/projects/e751285bee2b418396acf661808ccc30 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:56.445079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:56.536325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c675f-e922-4b1a-9872-a683ae1c54ed None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:56.568670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:56.569245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:56.569521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:56.569814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:56.570630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=e751285bee2b418396acf661808ccc30, user.id=8a2d77d595674b97b125721bd1757063) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:56.570934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:56.572350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae433b-b06a-4f92-988d-a89eeb5f9970 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:56.577853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 589/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:44:56 2022] GET /identity/v3/role_assignments?user.id=8a2d77d595674b97b125721bd1757063&scope.project.id=e751285bee2b418396acf661808ccc30&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:44:58.786144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a22bf9-baff-423a-8f29-c27523ce59ab None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:58.786654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a22bf9-baff-423a-8f29-c27523ce59ab None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:58.786654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a22bf9-baff-423a-8f29-c27523ce59ab None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:58.787962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 573/1162] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:44:58.793074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:58.793474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:58.793625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:58.810429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:44:58.811595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:44:58.874132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 590/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:44:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:44:58.896413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a22bf9-baff-423a-8f29-c27523ce59ab None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:58.990271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a22bf9-baff-423a-8f29-c27523ce59ab None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:59.021249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:59.021904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:59.022181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:59.022451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:59.084162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:59.085622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:59.177100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 574/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:44:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:44:59.183183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:59.275204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a094-16c7-4585-9563-9036c2a27fe2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:59.305966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:59.306742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:59.307022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:59.307295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:59.313572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:59.315565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-ffe5c5a0-f81f-49b9-a709-881343279c22 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:44:59.329094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:44:59.330154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:44:59.331631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 591/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:44:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:44:59.336627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:44:59.427566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80373e-04e7-401b-9218-07245a9dee9e None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:44:59.459386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:44:59.460027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:44:59.460302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:44:59.460570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:44:59.461271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:44:59.461569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:44:59.462954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595e0ff-2666-4be4-8477-7a9f3c51a71e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:44:59.469615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 575/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Mon May 16 16:44:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:01.660103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a9d41-fe07-49c2-bd09-bd02d8628363 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:01.660629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a9d41-fe07-49c2-bd09-bd02d8628363 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:01.660629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a9d41-fe07-49c2-bd09-bd02d8628363 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:01.662084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 592/1167] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:45:01.667273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be22d65-d9cd-48b4-908a-3db077a0f597 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:01.667665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be22d65-d9cd-48b4-908a-3db077a0f597 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:01.667837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be22d65-d9cd-48b4-908a-3db077a0f597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:01.684401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2be22d65-d9cd-48b4-908a-3db077a0f597 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:45:01.685590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2be22d65-d9cd-48b4-908a-3db077a0f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:45:01.747131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 576/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:45:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:45:01.769578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a9d41-fe07-49c2-bd09-bd02d8628363 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:01.864771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a9d41-fe07-49c2-bd09-bd02d8628363 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:01.896031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65389cd-4821-47a0-b9fe-6eede5bf0fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:01.896662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65389cd-4821-47a0-b9fe-6eede5bf0fa4 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:01.896943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65389cd-4821-47a0-b9fe-6eede5bf0fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:01.897215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65389cd-4821-47a0-b9fe-6eede5bf0fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:01.897957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65389cd-4821-47a0-b9fe-6eede5bf0fa4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:01.899317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65389cd-4821-47a0-b9fe-6eede5bf0fa4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:01.914104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 593/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Mon May 16 16:45:01 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:45:04.158869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f803e2-2ba5-4c3c-ae00-cfbf63285f7f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:04.159465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f803e2-2ba5-4c3c-ae00-cfbf63285f7f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:04.159465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f803e2-2ba5-4c3c-ae00-cfbf63285f7f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:04.160757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 577/1170] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:45:04.166007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:04.166415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:04.166558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:04.183213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:45:04.184381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:45:04.246248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 594/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:45:04.269782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f803e2-2ba5-4c3c-ae00-cfbf63285f7f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:04.363746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f803e2-2ba5-4c3c-ae00-cfbf63285f7f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:04.413075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b8169-3923-4111-9440-363d26c22c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:04.413961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b8169-3923-4111-9440-363d26c22c31 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:04.414235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b8169-3923-4111-9440-363d26c22c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:04.414503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b8169-3923-4111-9440-363d26c22c31 None admin] PATH_INFO: `/v3/domains/c139d354f5da489f8f754368a70f65d9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:04.424855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b8169-3923-4111-9440-363d26c22c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c139d354f5da489f8f754368a70f65d9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:04.426337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b8169-3923-4111-9440-363d26c22c31 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:04.427953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 578/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Mon May 16 16:45:04 2022] GET /identity/v3/domains/c139d354f5da489f8f754368a70f65d9 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:04.433712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:04.525503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5e8dc-7b1f-4a75-ad85-2c0469939ab0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:04.557434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71af42-651c-4073-ba51-e64db3ea2d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:04.558106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71af42-651c-4073-ba51-e64db3ea2d56 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:04.558385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71af42-651c-4073-ba51-e64db3ea2d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:04.558655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71af42-651c-4073-ba51-e64db3ea2d56 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:04.559356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71af42-651c-4073-ba51-e64db3ea2d56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:04.560786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71af42-651c-4073-ba51-e64db3ea2d56 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:04.584146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 595/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:45:04 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:45:06.914508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418e18-8c7b-4006-ba6b-a58f86960003 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:06.915065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418e18-8c7b-4006-ba6b-a58f86960003 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:06.915065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418e18-8c7b-4006-ba6b-a58f86960003 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:06.916393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 579/1174] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:45:06.921631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:06.922105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:06.922214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:06.938369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:45:06.939528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:45:07.000797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 596/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:45:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:45:07.026138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418e18-8c7b-4006-ba6b-a58f86960003 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:07.121093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418e18-8c7b-4006-ba6b-a58f86960003 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:07.152071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f6746-eb5d-42ef-a387-2108b1d44302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:07.152905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f6746-eb5d-42ef-a387-2108b1d44302 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:07.153181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f6746-eb5d-42ef-a387-2108b1d44302 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:07.153449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f6746-eb5d-42ef-a387-2108b1d44302 None admin] PATH_INFO: `/v3/domains/c139d354f5da489f8f754368a70f65d9` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:07.154628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f6746-eb5d-42ef-a387-2108b1d44302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c139d354f5da489f8f754368a70f65d9)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:07.156056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f6746-eb5d-42ef-a387-2108b1d44302 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:07.157640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 580/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Mon May 16 16:45:07 2022] GET /identity/v3/domains/c139d354f5da489f8f754368a70f65d9 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:07.163875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:07.258416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ae258-e532-4c0f-b205-4df95907c610 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:07.289349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f2d2c-eaaa-4157-89d0-c9247e408285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:07.290026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2d2c-eaaa-4157-89d0-c9247e408285 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:07.290309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2d2c-eaaa-4157-89d0-c9247e408285 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:07.290588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2d2c-eaaa-4157-89d0-c9247e408285 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:07.291285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2d2c-eaaa-4157-89d0-c9247e408285 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:07.292724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2d2c-eaaa-4157-89d0-c9247e408285 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:07.312225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 597/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:45:07 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:45:09.530851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068862bd-a27e-405c-9909-f071508e9db8 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:09.531374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068862bd-a27e-405c-9909-f071508e9db8 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:09.531374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068862bd-a27e-405c-9909-f071508e9db8 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:09.532748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 581/1178] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:45:09.538627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:09.539032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:09.539183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:09.555229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:45:09.556384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:45:09.618534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 598/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:45:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:45:09.641429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068862bd-a27e-405c-9909-f071508e9db8 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:09.735454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068862bd-a27e-405c-9909-f071508e9db8 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:09.766561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:09.767323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:09.767598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:09.768415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:09.777754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:45:09.785205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:45:09.786400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:45:09.787573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 582/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:45:09.792176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:09.884212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c76e32-bea1-4380-bbea-134aad854393 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:09.919549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:09.920199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:09.920477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:09.920749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:09.921484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:45:09.921815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:09.923194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:09.935324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 599/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:09.941458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:10.033960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea546-6a53-45e1-9e61-7979bf4b2eb2 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:10.064464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:10.065866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:10.066143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:10.066408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] PATH_INFO: `/v3/users/5f678e36f35d4511a8f5992c820ae6d1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:10.078491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] RBAC: Authorizing `identity:get_user(user_id=5f678e36f35d4511a8f5992c820ae6d1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:10.079941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:10.081638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 583/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:45:09 2022] GET /identity/v3/users/5f678e36f35d4511a8f5992c820ae6d1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:10.087322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:10.180417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712c2d2-9eb9-451f-b048-71e6be64ae03 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:10.211741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:10.212368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:10.212647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:10.212920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:10.274847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:10.276281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:10.368744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 600/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:45:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:45:10.374553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:10.464937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0269a-b56c-4bfd-93d1-e5bc5c657913 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:10.496435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df98b4c-1812-44a2-9c98-02da72337c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:10.497270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df98b4c-1812-44a2-9c98-02da72337c1e None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:10.497542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df98b4c-1812-44a2-9c98-02da72337c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:10.497833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df98b4c-1812-44a2-9c98-02da72337c1e None admin] PATH_INFO: `/v3/projects/4e772f2e32cd4ecaba0874b61c027902` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:10.498974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df98b4c-1812-44a2-9c98-02da72337c1e None admin] RBAC: Authorizing `identity:get_project(project_id=4e772f2e32cd4ecaba0874b61c027902)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:10.500385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df98b4c-1812-44a2-9c98-02da72337c1e None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:10.502087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 584/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:45:10 2022] GET /identity/v3/projects/4e772f2e32cd4ecaba0874b61c027902 => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:10.508029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:10.598698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9cb3a-d2d8-4f13-ae38-ed309d5ae1f8 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:10.631059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:10.631640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:10.631918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:10.632191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:10.633010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=4e772f2e32cd4ecaba0874b61c027902, user.id=5f678e36f35d4511a8f5992c820ae6d1) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:45:10.633316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:10.634765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c159f0-33cc-45bf-9b49-aecda26a9438 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:10.639863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 601/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:45:10 2022] GET /identity/v3/role_assignments?user.id=5f678e36f35d4511a8f5992c820ae6d1&scope.project.id=4e772f2e32cd4ecaba0874b61c027902&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:12.807359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422273a9-fd67-4d5e-91aa-91d5bd5b5e72 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:12.807871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422273a9-fd67-4d5e-91aa-91d5bd5b5e72 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:12.807871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422273a9-fd67-4d5e-91aa-91d5bd5b5e72 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:12.809195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 585/1186] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:45:12.814542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f10a-395b-4327-8908-11f21916a86a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:12.814919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f10a-395b-4327-8908-11f21916a86a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:12.815082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f10a-395b-4327-8908-11f21916a86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:12.831043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6157f10a-395b-4327-8908-11f21916a86a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:45:12.832191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6157f10a-395b-4327-8908-11f21916a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:45:12.893515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 602/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:45:12.915825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422273a9-fd67-4d5e-91aa-91d5bd5b5e72 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:13.009184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422273a9-fd67-4d5e-91aa-91d5bd5b5e72 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:13.040396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:13.041171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:13.041448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:13.041719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:13.051745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:45:13.059262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:45:13.060343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:45:13.061374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 586/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:45:13.075375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f10a-395b-4327-8908-11f21916a86a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:13.166338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f10a-395b-4327-8908-11f21916a86a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:13.197926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:13.198563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:13.198835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:13.199100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:13.199820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:45:13.200115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:13.201466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:13.208953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 603/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:13.214894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:13.312036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea189f6-0ab9-438b-bbc6-5e2ff7608543 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:13.342835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:13.343674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:13.343949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:13.344219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] PATH_INFO: `/v3/users/5f678e36f35d4511a8f5992c820ae6d1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:13.345374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] RBAC: Authorizing `identity:get_user(user_id=5f678e36f35d4511a8f5992c820ae6d1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:13.346878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:13.348465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 587/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:45:13 2022] GET /identity/v3/users/5f678e36f35d4511a8f5992c820ae6d1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:13.354212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:13.448064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329284c-a799-4dc4-bc44-9e309a9581b5 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:13.478909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826d732-8f1e-4815-a50f-b64408b82635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:13.479737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d732-8f1e-4815-a50f-b64408b82635 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:13.480012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d732-8f1e-4815-a50f-b64408b82635 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:13.480281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826d732-8f1e-4815-a50f-b64408b82635 None admin] PATH_INFO: `/v3/projects/4e772f2e32cd4ecaba0874b61c027902` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:13.481429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d732-8f1e-4815-a50f-b64408b82635 None admin] RBAC: Authorizing `identity:get_project(project_id=4e772f2e32cd4ecaba0874b61c027902)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:13.482886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826d732-8f1e-4815-a50f-b64408b82635 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:13.484558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 604/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:45:13 2022] GET /identity/v3/projects/4e772f2e32cd4ecaba0874b61c027902 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:13.491090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:13.582816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5119d6a-5f97-4206-83cb-c93fa0458190 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:13.614148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea18f3-4e85-4016-9709-4c9cb669544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:13.615000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea18f3-4e85-4016-9709-4c9cb669544a None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:13.615273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea18f3-4e85-4016-9709-4c9cb669544a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:13.615539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea18f3-4e85-4016-9709-4c9cb669544a None admin] PATH_INFO: `/v3/projects/4e772f2e32cd4ecaba0874b61c027902/users/5f678e36f35d4511a8f5992c820ae6d1/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:13.617415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea18f3-4e85-4016-9709-4c9cb669544a None admin] RBAC: Authorizing `identity:create_grant(project_id=4e772f2e32cd4ecaba0874b61c027902, user_id=5f678e36f35d4511a8f5992c820ae6d1, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:13.618857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea18f3-4e85-4016-9709-4c9cb669544a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:13.630557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 588/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:45:13 2022] PUT /identity/v3/projects/4e772f2e32cd4ecaba0874b61c027902/users/5f678e36f35d4511a8f5992c820ae6d1/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:45:15.819843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db08b33-05ee-4fe3-87ab-aad2e78679b2 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:15.820351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db08b33-05ee-4fe3-87ab-aad2e78679b2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:15.820570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db08b33-05ee-4fe3-87ab-aad2e78679b2 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:15.822674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 605/1193] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:45:15.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:15.828648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:15.828766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:15.846118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:45:15.847359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:45:15.910475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 589/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:45:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:45:15.933757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db08b33-05ee-4fe3-87ab-aad2e78679b2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:16.025928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db08b33-05ee-4fe3-87ab-aad2e78679b2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:16.057245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:16.058033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:16.058307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:16.058575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:16.068004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:45:16.075402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:45:16.076605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:45:16.077847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 606/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:45:16.082844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:16.173447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e35e-ee78-45b3-9a1b-27c4b1b3363a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:16.205846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:16.206493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:16.206766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:16.207034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:16.207763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:45:16.208061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:16.209419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:16.216944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 590/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:16.223276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:16.315842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcdf07-6b83-4175-8c49-26d794646689 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:16.347413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:16.348258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:16.348538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:16.348809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] PATH_INFO: `/v3/users/5f678e36f35d4511a8f5992c820ae6d1` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:16.350007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] RBAC: Authorizing `identity:get_user(user_id=5f678e36f35d4511a8f5992c820ae6d1)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:16.351441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:16.353031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 607/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Mon May 16 16:45:16 2022] GET /identity/v3/users/5f678e36f35d4511a8f5992c820ae6d1 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:16.358582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:16.450975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28317e6c-e133-40f2-bc2c-081f02d47b4d None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:16.481730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:16.482389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:16.482669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:16.482938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:16.544370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:16.545835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:16.635390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 591/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:45:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:45:16.641137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:16.736420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd822-1d58-4972-88da-7db0b3405a38 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:16.767201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012297c-af09-4b5b-bad7-48d0d524a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:16.768612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012297c-af09-4b5b-bad7-48d0d524a34c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:16.768890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012297c-af09-4b5b-bad7-48d0d524a34c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:16.769159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012297c-af09-4b5b-bad7-48d0d524a34c None admin] PATH_INFO: `/v3/projects/4e772f2e32cd4ecaba0874b61c027902` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:16.770322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012297c-af09-4b5b-bad7-48d0d524a34c None admin] RBAC: Authorizing `identity:get_project(project_id=4e772f2e32cd4ecaba0874b61c027902)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:16.771752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012297c-af09-4b5b-bad7-48d0d524a34c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:16.773395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 608/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon May 16 16:45:16 2022] GET /identity/v3/projects/4e772f2e32cd4ecaba0874b61c027902 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:45:16.779282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:45:16.869428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bb49b-cc2c-4328-a2ca-c662fc36a4c6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:45:16.900543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:45:16.901114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:45:16.901385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:45:16.901652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:45:16.902492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=4e772f2e32cd4ecaba0874b61c027902, user.id=5f678e36f35d4511a8f5992c820ae6d1) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:45:16.902801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:45:16.904224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46308111-2848-4e38-9369-3445c1a8c5f2 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:45:16.909696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 592/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:45:16 2022] GET /identity/v3/role_assignments?user.id=5f678e36f35d4511a8f5992c820ae6d1&scope.project.id=4e772f2e32cd4ecaba0874b61c027902&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:17.647091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b8ead-e180-4b53-91ba-78efcb7d214e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:17.647701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b8ead-e180-4b53-91ba-78efcb7d214e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:17.647701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b8ead-e180-4b53-91ba-78efcb7d214e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:17.651158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 609/1201] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:17.657782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:17.657782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:17.660198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:17.678636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:17.680161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:17.761172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 593/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 16 16:46:17.789271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b8ead-e180-4b53-91ba-78efcb7d214e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:17.915685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b8ead-e180-4b53-91ba-78efcb7d214e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:17.963819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:17.964789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:17.964983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:17.965314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:17.977771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:17.979496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:17.999665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:18.001179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:18.002864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:18.002864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:18.002864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:18.002864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:18.002864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 610/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:18.011083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:18.127151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffd20-04bb-4a15-ac88-b648097019cf None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:18.165146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:18.165942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:18.166231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:18.166505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:18.167312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:18.167633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:18.169078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862bc44-153f-4d39-987f-5d6d6a381e6c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:18.187090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 594/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:18.190814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:18.308366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3e9bf-adb0-4bcd-81d3-1f5386f9602e None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:18.347331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8cf69-970d-4098-ba6f-852c117d6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:18.348030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cf69-970d-4098-ba6f-852c117d6ae0 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:18.348327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cf69-970d-4098-ba6f-852c117d6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:18.348603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cf69-970d-4098-ba6f-852c117d6ae0 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:18.349298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8cf69-970d-4098-ba6f-852c117d6ae0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:18.350831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8cf69-970d-4098-ba6f-852c117d6ae0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:18.385351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 611/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Mon May 16 16:46:18 2022] POST /identity/v3/users => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:46:20.763711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18457bcd-005f-4432-bfda-b210a6de3310 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:20.764260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18457bcd-005f-4432-bfda-b210a6de3310 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:20.764260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18457bcd-005f-4432-bfda-b210a6de3310 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:20.765762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 595/1206] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:20.771458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:20.771888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:20.772036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:20.789212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:20.790432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:20.862402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 612/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:20.890097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18457bcd-005f-4432-bfda-b210a6de3310 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:21.003254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18457bcd-005f-4432-bfda-b210a6de3310 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:21.042224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:21.042977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:21.043252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:21.043556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:21.054398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:46:21.062260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:21.063928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:21.064891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 596/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:21.070180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:21.175583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa7149-21ff-421f-b4c6-772896324675 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:21.211823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:21.212497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:21.212779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:21.213053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:21.213832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:21.214195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:21.215546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:21.223563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 613/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:46:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:21.232005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:21.334233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a063-bdf3-4d5f-a49b-638357d96a6c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:21.368380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:21.369166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:21.369445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:21.369716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:21.382288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:21.383741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:21.400785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:21.401800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:21.402723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:21.402723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:21.402723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:21.402723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:21.408353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 597/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:21.408508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:21.516278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7bc77-e346-4b49-9804-58a51748a125 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:21.550970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:21.551665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:21.551949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:21.552263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:21.552953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:21.553426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:21.554850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:21.567568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 614/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:21.573204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:21.682568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba3f9c-be51-4c93-b39b-cefff831e204 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:21.720800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:21.721722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:21.722040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:21.722317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:21.731501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:21.731642 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:46:21.747712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:21.748767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:21.750380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 598/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:21.754747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:21.856213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdd1fe-fde7-4376-bd31-a605f51ea97a None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:21.893130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:21.893901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:21.894159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:21.894432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:21.895316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:21.895657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:21.897236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:21.915436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 615/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Mon May 16 16:46:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:21.921161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:22.029036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adec8c-e30f-484c-bcce-159160450480 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:22.067387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:22.068054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:22.068329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:22.068596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:22.146933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:22.148438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:22.264120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 599/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:46:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:46:22.271652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:22.390336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563a8f-a564-4665-9a2a-f8eefbf99cb4 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:22.429117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:22.430121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:22.430505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:22.430880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:22.442842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:22.444270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:22.464245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:22.470889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:22.471996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:22.471996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:22.471996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:22.471996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:22.471996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 616/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:22.472340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:22.586370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159b5bd-7f61-445f-a6dd-e7f028ec431c None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:22.626700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:22.627457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:22.630121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:22.630121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:22.630121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:22.630121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:22.630653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:22.644443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 600/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:22.650089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:22.760959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bd747-e706-4fa8-8a2d-ae9a0ee6ea2d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:22.797229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:22.798158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:22.798506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:22.798846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:22.805978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:22.807521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:46:22.821725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:22.822876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:22.823987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:22.830211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 617/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:22.831115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:22.947996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b9fc9-ae48-4e2f-9d3a-d358c47e3e09 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:22.996038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:22.996038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:22.996038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:22.996038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:22.999545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:22.999545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:22.999545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8a226-920d-4604-a399-fb2372bdc8e0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:23.006484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 601/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:23.013153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:23.127498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c39cd-f67d-4dd3-b540-0e1263c8e579 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:23.166383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:23.167148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:23.167395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:23.167622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:23.168532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=4147f3dfb94f49a0b6e08d16323d51a3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:23.168840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:23.170313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83523464-8e6d-4257-98ea-948d16818844 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:23.181782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 618/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:46:23 2022] GET /identity/v3/role_assignments?user.id=4147f3dfb94f49a0b6e08d16323d51a3&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:25.702323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e865-f460-4bb5-8dea-a6e71bd60fb5 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:25.702840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e865-f460-4bb5-8dea-a6e71bd60fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:25.702840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063e865-f460-4bb5-8dea-a6e71bd60fb5 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:25.705207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 602/1220] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:25.713191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:25.713191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:25.713191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:25.730298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:25.731723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:25.806243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 619/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:25.829002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063e865-f460-4bb5-8dea-a6e71bd60fb5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:25.936519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063e865-f460-4bb5-8dea-a6e71bd60fb5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:25.975414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:25.976475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:25.976756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:25.977034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:25.990531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:46:25.998253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:25.999186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:26.000054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 603/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:46:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:26.005510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:26.113519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d079e-4554-453f-8e3f-4897cc0950e5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:26.155489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:26.156163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:26.156437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:26.157286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:26.158033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] RBAC: Adding query filter params (name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:26.158331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:26.159784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:26.168989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 620/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:46:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:26.174659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:26.277865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a5f4e-9a7d-4a6a-bf12-e395bd54b822 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:26.312227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:26.313619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:26.313932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:26.314234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:26.326429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:26.328007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:26.347299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:26.348564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:26.350109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:26.350109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:26.350109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:26.350109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:26.350109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 604/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:26.354810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:26.460718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be951616-5854-4eed-8e15-7addfc07c176 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:26.493345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:26.494033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:26.494307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:26.494574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:26.495302 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:26.495599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:26.496961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:26.508829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 621/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:26.514844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:26.616243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46313f6d-b77d-41e5-8b76-b50ba96d31e1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:26.647875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:26.648659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:26.648931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:26.649194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:26.656247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:26.657892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:46:26.671871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:26.673499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:26.674792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 605/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:26.679535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:26.785213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532a5ff-0833-4c02-85a1-30ced3900bda None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:26.821439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:26.822208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:26.822557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:26.822786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:26.823720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:26.824027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:26.825447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:26.842432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 622/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Mon May 16 16:46:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:26.848335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:26.956905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcca6f8-31bc-41e6-9609-1ccc317b0265 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:26.993622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:26.994450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:26.994722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:26.995053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:27.006309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:27.007852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:27.026880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:27.028170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:27.029103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:27.029103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:27.029103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:27.029103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:27.029103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 606/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:27.034834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:27.142148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee254b-e92f-4aa0-bea9-21bbb2f32c65 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:27.176113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:27.176763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:27.177073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:27.177341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:27.178083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:27.178371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:27.179836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:27.191069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 623/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:27.197138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:27.302205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345bdd3-5923-45a0-8f45-753b5df961e1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:27.340331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:27.341146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:27.341417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:27.341713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:27.349420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:27.350863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:46:27.364586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:27.365510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:27.366513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:27.372143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 607/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:27.372296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:27.475142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe2b90-9b71-49eb-9526-cef3a59e33be None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:27.510926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:27.511577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:27.511889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:27.512125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:27.512915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:27.513193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:27.514695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140c764-0c83-4b34-8738-2d7082f548fe None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:27.527897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 624/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:27.534661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:27.637105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fa78-f4a1-4b8c-9190-a76c34c07c35 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:27.669140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7829e-8b90-476a-bf19-b833f7a86d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:27.670048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7829e-8b90-476a-bf19-b833f7a86d3d None admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:27.670320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7829e-8b90-476a-bf19-b833f7a86d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:27.670588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7829e-8b90-476a-bf19-b833f7a86d3d None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/4147f3dfb94f49a0b6e08d16323d51a3/roles/7466cd546e3b430cb31cf2343457bc97` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:27.684532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7829e-8b90-476a-bf19-b833f7a86d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=4147f3dfb94f49a0b6e08d16323d51a3, role_id=7466cd546e3b430cb31cf2343457bc97)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:27.686018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7829e-8b90-476a-bf19-b833f7a86d3d None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:27.699079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 608/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:46:27 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/4147f3dfb94f49a0b6e08d16323d51a3/roles/7466cd546e3b430cb31cf2343457bc97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:46:30.039941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995a57d-bfe1-4348-b6f4-103a69f19ffa None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.040536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995a57d-bfe1-4348-b6f4-103a69f19ffa None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.040536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995a57d-bfe1-4348-b6f4-103a69f19ffa None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:30.042115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 625/1233] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:30.047105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.047568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.047788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:30.064532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:30.065844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:30.131027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 609/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:30.156975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995a57d-bfe1-4348-b6f4-103a69f19ffa None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:30.263901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995a57d-bfe1-4348-b6f4-103a69f19ffa None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:30.299116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:30.299839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.300160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.300422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:30.312693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:46:30.323978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:30.326115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:30.327474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 626/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Mon May 16 16:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:30.332431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:30.444415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb38645-c7d0-422f-b9f7-70f91953d6c3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:30.484279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:30.485477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.485776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.486048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:30.486785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] RBAC: Adding query filter params (name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:30.487085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:30.488456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:30.496818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 610/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Mon May 16 16:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:30.503657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:30.609473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663183a1-faf1-4706-9fa2-09e0313b9b0d None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:30.645437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:30.646251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.646526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.646791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:30.659027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:30.660491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:30.678514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:30.679544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:30.680515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:30.680515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:30.680515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:30.680515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:30.680515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 627/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:30.685908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:30.798787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7e1c0-f793-45ce-a2dc-677f5bb65ebc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:30.834233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:30.834882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.835159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.835428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:30.836133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:30.836432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:30.837818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:30.851903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 611/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:30.857700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:30.961591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43aafe-9c37-4d8e-a720-cc129407bfb6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:30.998044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:30.998926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:30.999233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:30.999553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:31.008711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:31.010354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:46:31.026628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:31.027736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:31.034045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 628/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:31.034650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:31.141883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c8dd-08b8-471a-88e4-c7cc5b55fce3 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:31.175095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:31.175760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:31.176039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:31.176296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:31.177114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:31.177420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:31.178923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:31.195563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 612/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Mon May 16 16:46:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:31.201383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:31.311492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb60f9-e1e1-45f2-8fdd-bec61184ce4c None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:31.357638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:31.358348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:31.358654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:31.359199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:31.428561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:31.430065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:31.553512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 629/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:46:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:46:31.559757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:31.678304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2553be-2dd8-47db-a235-0a516aa6fbb0 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:31.714848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:31.715640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:31.715912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:31.716177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:31.730926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:31.732460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:31.754600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:31.755695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:31.761447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:31.761447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:31.761447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:31.761447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:31.761447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 613/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 16 16:46:31.762173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:31.878969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4057-91ac-41ea-b083-e2be76a94310 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:31.918780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:31.919526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:31.919844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:31.920113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:31.920834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:31.921163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:31.922647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:31.935795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 630/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:31.941417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:32.054754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1934-2b69-40cd-a817-45b92e111936 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:32.097443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:32.098341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:32.098646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:32.098997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:32.106150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:32.107707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:46:32.121302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:32.122400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:32.123294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 614/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:32.128921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:32.235517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82164507-3dad-47f3-823c-410f119c95f7 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:32.268170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:32.268824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:32.269103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:32.269376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:32.270255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:32.270563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:32.272008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b2b6d-f130-4500-bbaf-3fb24baef543 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:32.284133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 631/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:32.290297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:32.401018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68234d65-d7f0-4dc5-a49a-3cc332677930 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:32.441005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:32.441800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:32.442173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:32.442477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:32.443390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] RBAC: Adding query filter params (role.id=7466cd546e3b430cb31cf2343457bc97, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=4147f3dfb94f49a0b6e08d16323d51a3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:32.443788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:32.445474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc3319-896f-4073-958c-4e240f981687 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:32.452225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 615/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:46:32 2022] GET /identity/v3/role_assignments?user.id=4147f3dfb94f49a0b6e08d16323d51a3&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=7466cd546e3b430cb31cf2343457bc97 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:34.760809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1876-ea61-41bb-8c31-7e2ed674105b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:34.761475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1876-ea61-41bb-8c31-7e2ed674105b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:34.761475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1876-ea61-41bb-8c31-7e2ed674105b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:34.762981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 632/1247] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:34.769091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:34.769620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:34.769620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:34.785976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:34.787212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:34.856536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 616/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:34.881089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e1876-ea61-41bb-8c31-7e2ed674105b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:34.987929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e1876-ea61-41bb-8c31-7e2ed674105b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:35.023780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:35.024494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:35.024841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:35.025106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:35.035630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:46:35.043320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:35.044517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:46:35.045481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:35.050135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 633/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:35.051253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:35.157444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c42b4-8e64-4a26-90dc-3da47391f21e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:35.199500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:35.200290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:35.200594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:35.200909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:35.201937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:35.202258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:35.204263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:35.213750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 617/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:35.219962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:35.334255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81570b6-7678-452c-9469-31eab8c77b4f None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:35.377920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:35.378823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:35.379123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:35.379466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:35.391965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:35.394400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:35.414257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:35.415366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:35.416394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:35.416394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:35.416394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:35.416394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:35.416394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 634/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:35.421602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:35.535046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec76b7-aa52-4779-a105-27e3ceb6d5ee None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:35.570371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:35.571029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:35.571306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:35.571573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:35.572285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:35.572585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:35.573982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:35.587610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 618/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:35.593585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:35.697217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b254d-9733-43c8-88b4-c04c07204ac6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:35.734499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:35.735297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:35.735578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:35.735852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:35.744138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:35.745586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:46:35.761424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:35.763695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:35.764889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 635/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:35.769204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:35.882084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef804ce-0ac8-4c98-8e5f-87dca71624c6 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:35.918953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:35.919784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:35.920069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:35.920451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:35.921342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:35.921662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:35.923154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:35.942260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 619/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Mon May 16 16:46:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:35.948201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:36.054808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24490f8c-a2d4-4bf8-b7f6-7a3c79563de2 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:36.090172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:36.090823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:36.091103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:36.091412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:36.168506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:36.170181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:36.275271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 636/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:46:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:46:36.279812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:36.396640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c493809-612a-4172-b9e0-e6464ef3a237 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:36.435071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:36.435781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:36.436055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:36.436335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:36.448004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:36.449555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:36.467012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:36.468044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:36.469287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:36.469287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:36.469287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:36.469287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:36.469287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 620/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:36.474152 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:36.576791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40880d2c-2e2b-4d23-bebd-f9985625a1fe None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:36.613221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:36.613988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:36.614259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:36.614530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:36.615417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:36.615751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:36.617407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:36.630538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 637/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:36.636371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:36.737227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837c2e-ccfa-4768-a61e-f00b52476524 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:36.771452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:36.772254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:36.772546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:36.772850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:36.779429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:36.780846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:46:36.794906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:36.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:36.797890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 621/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:36.802946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:36.908950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2740-097f-49a6-9ba6-9bcbeaee49f0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:36.944287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:36.944960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:36.945237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:36.945507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:36.946335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:36.946637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:36.948129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922e0f-35bb-468f-9128-eda9b242e70f None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:36.961027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 638/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:46:36.967233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:37.067872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f26455-3799-4f4c-9d48-e5c7c92109b8 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:37.102063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:37.102723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:37.103006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:37.103277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:37.104116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=4147f3dfb94f49a0b6e08d16323d51a3) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:37.104422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:37.105909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9493c1b-bfc4-4850-9d8c-4ce9519a351c None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:37.112295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 622/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:46:36 2022] GET /identity/v3/role_assignments?user.id=4147f3dfb94f49a0b6e08d16323d51a3&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:39.320080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be690-33d8-4537-aa4a-ed4abddfef84 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:39.320622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be690-33d8-4537-aa4a-ed4abddfef84 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:39.320622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be690-33d8-4537-aa4a-ed4abddfef84 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:39.322390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 639/1261] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:39.327570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:39.328010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:39.328105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:39.344359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:39.345533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:39.408587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 623/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:39.437063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be690-33d8-4537-aa4a-ed4abddfef84 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:39.537243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be690-33d8-4537-aa4a-ed4abddfef84 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:39.569132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:39.569935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:39.570268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:39.570489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:39.579994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:46:39.587476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:39.588536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:39.589577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 640/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:39.594696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:39.690325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d326405-3050-45ac-8861-f5225b42e2b1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:39.721269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:39.721945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:39.722219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:39.722484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:39.723213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:39.723515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:39.724871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:39.732389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 624/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:39.739000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:39.837702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c34ea0-3b11-40e5-80ff-699a0a25e216 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:39.869650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:39.870451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:39.870729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:39.870999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:39.881375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:39.882851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:39.899539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:39.900545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:39.901476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:39.901476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:39.901476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:39.901476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:39.901476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 641/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:39.906437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:39.997294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a2658-0dcc-4ec2-bb6a-2dd732a8f756 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.028586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.029220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.029492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.029777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.030480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:40.030777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.032122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.045345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 625/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:40.051497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:40.150582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77911d0-24b6-4f47-aa62-955bac76d2f3 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.181698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.182503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.182773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.183035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.191298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.192725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:46:40.206304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:40.207400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:40.208497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 642/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:40.213238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:40.304831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b60dad-3bc5-48db-9041-519ef35e62d4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.342232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.342960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.343336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.343551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.344542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:40.344866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.346523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.364069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 626/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Mon May 16 16:46:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:40.369645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:40.467491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb0a66-4ae9-458a-9e50-291222001c06 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.500235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.501007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.501280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.501545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.511273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.512700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:40.528552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:40.529440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:40.530577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:40.530577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:40.530577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:40.530577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:40.530577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 643/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:40.535887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:40.627396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ca54-1a0f-4187-8e26-e5fb37647135 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.658395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.659029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.659352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.659571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.660278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:40.660579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.661964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.672903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 627/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:40.678283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:40.772161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb845c87-23eb-49d2-ab38-058e27fa5bd6 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.803327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.804105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.804384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.804657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.810988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.812455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:46:40.826049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:40.826925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:40.827828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 644/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:46:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:40.833556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:40.925120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6230d9-9168-4dfc-8204-b5c6fd2159b7 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:40.955506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:40.956132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:40.956405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:40.956672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:40.957432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:40.957731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:40.959160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efe115-4bf2-4a92-8aa2-cae95f63fa40 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:40.970504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 628/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:46:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:40.976366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:41.069017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e724fe-84a2-4df0-9c5c-8e3842fb5203 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:41.099438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84c66c-8654-4ff4-876f-a9b329101310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:41.100291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84c66c-8654-4ff4-876f-a9b329101310 None admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:41.100559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84c66c-8654-4ff4-876f-a9b329101310 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:41.100819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84c66c-8654-4ff4-876f-a9b329101310 None admin] PATH_INFO: `/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/4147f3dfb94f49a0b6e08d16323d51a3/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:41.102730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84c66c-8654-4ff4-876f-a9b329101310 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c591b8c8d8644c4be2153a81bd6b4a1, user_id=4147f3dfb94f49a0b6e08d16323d51a3, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:41.104138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84c66c-8654-4ff4-876f-a9b329101310 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:41.117148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 645/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Mon May 16 16:46:40 2022] PUT /identity/v3/projects/0c591b8c8d8644c4be2153a81bd6b4a1/users/4147f3dfb94f49a0b6e08d16323d51a3/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:46:43.288452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9fbd-f542-4a41-971d-c4c480f635c6 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:43.289021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9fbd-f542-4a41-971d-c4c480f635c6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:43.289021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9fbd-f542-4a41-971d-c4c480f635c6 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:43.290369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 629/1274] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:43.295567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:43.295941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:43.296116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:43.313543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:43.314782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:43.378405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 646/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:43.401372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9fbd-f542-4a41-971d-c4c480f635c6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:43.496137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9fbd-f542-4a41-971d-c4c480f635c6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:43.526852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:43.527626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:43.527900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:43.528165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:43.538091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(role_id) May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 16 16:46:43.545568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:43.547273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:43.548334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 630/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Mon May 16 16:46:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:43.553234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:43.643171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641f5-bbfc-44d9-acf5-a1610b1d7f47 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:43.679824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:43.680476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:43.680750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:43.681019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:43.681774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:43.682071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:43.683435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:43.691427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 647/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Mon May 16 16:46:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:43.697009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:43.789443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61317-ba50-4b83-9068-8e3a9500ce56 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:43.825111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:43.825886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:43.826161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:43.826495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:43.836601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:43.838072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:43.854113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:43.854980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:43.855874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:43.855874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:43.855874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:43.855874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:43.855874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 631/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:43.861732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:43.954693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3774e-2c23-427e-93b3-23ef19649864 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:43.986514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:43.987169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:43.987443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:43.987711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:43.988414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:43.988711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:43.990108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:44.001260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 648/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:44.006831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:44.108003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692ce5-320d-4b1e-a9d3-92b7131e2223 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:44.141057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:44.141863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:44.142137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:44.142402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:44.149350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:44.150811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_user(user_id) May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 16 16:46:44.164937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:44.166026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:44.167008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 632/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:44.171860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:44.264584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7b90-4ed5-45b7-83af-e8043106dced None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:44.295992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:44.296666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:44.296945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:44.297218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:44.298068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:44.298372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:44.299792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:44.319738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 649/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Mon May 16 16:46:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:44.325692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:44.418346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825b6d9-f6df-4612-b0bc-e8631ced627f None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:44.449204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:44.449860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:44.450134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:44.450398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:44.511794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:44.513211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:44.603929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 633/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Mon May 16 16:46:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 16 16:46:44.609931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:44.700586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b033e-19db-4e1d-a060-20363210e8c0 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:44.733182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:44.734259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:44.734534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:44.734801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:44.744174 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:44.745615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 16 16:46:44.762156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:44.763292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:44.764401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 16 16:46:44.764401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 16 16:46:44.764401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 16 16:46:44.764401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:44.764401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 650/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:44.769566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:44.861130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfcf0d-c9e5-4100-a549-339069320245 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:44.892175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:44.892811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:44.893084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:44.893348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:44.894076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:44.894375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:44.895716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:44.906757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 634/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Mon May 16 16:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:44.912313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:45.004648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5e291-0be0-4b57-bf4c-0a62d1d2c2ac None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:45.035927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:45.036693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:45.036971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:45.037245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:45.043644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:45.045099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(project_id) May 16 16:46:45.058470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:45.059397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 16:46:45.060327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 651/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Mon May 16 16:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:45.065917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:45.156674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a231-e4f2-41b4-8b3b-446a5420aee1 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:45.186465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:45.187093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:45.187864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:45.188128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:45.188883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:45.189181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:45.190607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0b266-0cfc-4760-9547-eec2fc64d036 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:45.201596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 635/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Mon May 16 16:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:45.208020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:45.301006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6e5bf-4d0d-452f-98ab-23e7ca2aa622 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:45.337024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:45.337664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:45.337965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:45.338231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:45.339041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] RBAC: Adding query filter params (role.id=b991e55ff57e404a92b0f2d7339efc00, scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1, user.id=4147f3dfb94f49a0b6e08d16323d51a3) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:45.339341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:45.340762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972c8ee-7248-4840-8949-76338d37dc75 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:45.346370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 652/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Mon May 16 16:46:45 2022] GET /identity/v3/role_assignments?user.id=4147f3dfb94f49a0b6e08d16323d51a3&scope.project.id=0c591b8c8d8644c4be2153a81bd6b4a1&role.id=b991e55ff57e404a92b0f2d7339efc00 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:47.568419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaeea7-e7b9-474b-bef0-6d9cbba70828 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:47.568945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaeea7-e7b9-474b-bef0-6d9cbba70828 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:47.568945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaeea7-e7b9-474b-bef0-6d9cbba70828 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:47.570375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 636/1288] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:47.575541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:47.575954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:47.576091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:47.592417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:47.593597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:47.655599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 653/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:47.677803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaeea7-e7b9-474b-bef0-6d9cbba70828 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:47.780714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaeea7-e7b9-474b-bef0-6d9cbba70828 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:47.813626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:47.814432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:47.814702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:47.814965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:47.815607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:47.816971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:47.828218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:47.829402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:47.830298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 637/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:46:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:47.835577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:47.927546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5bfb5-5ff0-40b0-b53b-54e8e21946f8 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:47.958234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:47.958816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:47.959094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:47.959363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:47.960059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:47.960359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:47.961711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4e120-3367-494a-8e70-e5cc51b4c684 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:47.966268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 654/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Mon May 16 16:46:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:47.972195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:48.063187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97366499-8750-4811-9415-36bf8fe313c4 None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:48.093259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:48.094438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:48.094712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:48.094982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] PATH_INFO: `/v3/services` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:48.095664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:48.095958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:48.097296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5e763-f983-45ea-9cb9-b4f5dcbfb525 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:48.101397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 638/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Mon May 16 16:46:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:50.266647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efedf38-f949-4b4a-82a5-3d5ce161f7a6 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:50.267184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efedf38-f949-4b4a-82a5-3d5ce161f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:50.267184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efedf38-f949-4b4a-82a5-3d5ce161f7a6 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:50.268530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 655/1293] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:50.273555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99256662-aaaa-42ae-afd3-6f358cdf9211 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:50.273966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99256662-aaaa-42ae-afd3-6f358cdf9211 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:50.274135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99256662-aaaa-42ae-afd3-6f358cdf9211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:50.290145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-99256662-aaaa-42ae-afd3-6f358cdf9211 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:50.291304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-99256662-aaaa-42ae-afd3-6f358cdf9211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:50.357564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 639/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:50.381625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efedf38-f949-4b4a-82a5-3d5ce161f7a6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:50.475991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efedf38-f949-4b4a-82a5-3d5ce161f7a6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:50.507050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cea1c3-3026-49a1-8c5b-1584a4f6bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:50.507686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cea1c3-3026-49a1-8c5b-1584a4f6bfe1 None admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:50.507959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cea1c3-3026-49a1-8c5b-1584a4f6bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:50.508223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cea1c3-3026-49a1-8c5b-1584a4f6bfe1 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:50.508916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cea1c3-3026-49a1-8c5b-1584a4f6bfe1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:50.510389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cea1c3-3026-49a1-8c5b-1584a4f6bfe1 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:50.523125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 656/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Mon May 16 16:46:50 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:46:52.739639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba67a6-5789-4285-b5d4-146cc8bd5428 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:52.740146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba67a6-5789-4285-b5d4-146cc8bd5428 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:52.740146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba67a6-5789-4285-b5d4-146cc8bd5428 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:52.741438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 640/1296] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:52.746574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:52.746964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:52.747126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:52.763623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:52.764781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:52.831876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 657/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:52.853911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba67a6-5789-4285-b5d4-146cc8bd5428 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:52.947913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba67a6-5789-4285-b5d4-146cc8bd5428 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:52.978397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:52.979167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:52.979445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:52.979716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] PATH_INFO: `/v3/services/placement` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:52.980356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:52.981722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:52.993886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:53.000067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:53.001113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 641/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:46:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:53.002120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:53.091854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cd5fd-89d2-4a2b-973e-f249c393e72e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:53.123354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:53.123995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:53.124271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:53.125128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:53.125843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:53.126145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:53.127528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:53.132362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 658/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Mon May 16 16:46:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:53.138575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:53.229407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6111d-96f1-403e-8696-f2be6b82cbdc None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:53.260099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:53.260667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:53.260941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:53.261209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:53.262003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] RBAC: Adding query filter params (interface=public, service_id=d83a92d80a8f486f97049a4abbb4c095, region_id=RegionOne) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:53.262309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:53.263652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d40f-35a7-47b5-aa46-6ccbc45fc342 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:53.268997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 642/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Mon May 16 16:46:53 2022] GET /identity/v3/endpoints?service_id=d83a92d80a8f486f97049a4abbb4c095&interface=public®ion_id=RegionOne => generated 194 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:53.274457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:53.367992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bf963-bd9d-4589-ae58-10b9b0dc0e59 None admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:53.399042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3fa34-b2f6-4555-8174-80d456b0d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:53.399676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3fa34-b2f6-4555-8174-80d456b0d51d None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:53.399950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3fa34-b2f6-4555-8174-80d456b0d51d None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:53.400217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3fa34-b2f6-4555-8174-80d456b0d51d None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:53.400878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3fa34-b2f6-4555-8174-80d456b0d51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:53.402258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3fa34-b2f6-4555-8174-80d456b0d51d None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:53.410029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 659/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Mon May 16 16:46:53 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:46:55.633964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3af0-c45a-4112-a505-315d11a19696 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:55.634498 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3af0-c45a-4112-a505-315d11a19696 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:55.634498 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3af0-c45a-4112-a505-315d11a19696 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:55.635842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 643/1302] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:46:55.641029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:55.641455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:55.641563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:55.658113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:46:55.659268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:46:55.725588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 660/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:46:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 16 16:46:55.748514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3af0-c45a-4112-a505-315d11a19696 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:55.843309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3af0-c45a-4112-a505-315d11a19696 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:55.884578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:55.885359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:55.885630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:55.885923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:55.886560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:55.887917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 16:46:55.899109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._get_service(service_id) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 16:46:55.900254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.get_or_create( May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application with Lock( May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self._enter() May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application return self.creator() May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application created_value = creator( May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: ERROR keystone.server.flask.application May 16 16:46:55.901308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 644/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Mon May 16 16:46:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 16 16:46:55.906484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:55.996501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9e733-c1c4-448c-835d-4bd87343b7b2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:56.027705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:56.028341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:56.028614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:56.028882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] PATH_INFO: `/v3/services` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:56.029565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:46:56.029900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:56.031254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e339b9-df45-490e-a7be-f4f3bdc5ecb2 None admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:56.036074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 661/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Mon May 16 16:46:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:46:56.041553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:46:56.134852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364819f-296b-479c-bed9-cac689a4d02a None admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:46:56.167511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68039a-c992-4cc0-a565-ed8727a90554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:46:56.168164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68039a-c992-4cc0-a565-ed8727a90554 None admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:46:56.168444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68039a-c992-4cc0-a565-ed8727a90554 None admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:46:56.168712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68039a-c992-4cc0-a565-ed8727a90554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:46:56.169450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68039a-c992-4cc0-a565-ed8727a90554 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:46:56.170844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68039a-c992-4cc0-a565-ed8727a90554 None admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:46:56.189832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 645/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Mon May 16 16:46:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:47:59.622072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86ccc2-d8be-40bf-bf71-9366779e3bd1 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:47:59.623545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86ccc2-d8be-40bf-bf71-9366779e3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:47:59.623978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86ccc2-d8be-40bf-bf71-9366779e3bd1 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:47:59.629419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 662/1307] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:47:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:47:59.630970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6b9d-abdd-409b-a319-3643eec03580 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:47:59.631835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6b9d-abdd-409b-a319-3643eec03580 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:47:59.632492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6b9d-abdd-409b-a319-3643eec03580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:47:59.720744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2d8e6b9d-abdd-409b-a319-3643eec03580 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:47:59.722225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2d8e6b9d-abdd-409b-a319-3643eec03580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:47:59.828633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 646/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:47:59.879072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd06a-daac-415a-b2d7-64963a1aa8d6 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:47:59.879315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd06a-daac-415a-b2d7-64963a1aa8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:47:59.879592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cd06a-daac-415a-b2d7-64963a1aa8d6 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:47:59.881181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 663/1309] 10.222.0.70 () {54 vars in 964 bytes} [Mon May 16 16:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:47:59.891857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907308-2475-4eed-bb53-2f4b52a517c5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:47:59.892151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907308-2475-4eed-bb53-2f4b52a517c5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:47:59.892408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0907308-2475-4eed-bb53-2f4b52a517c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:00.004706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b0907308-2475-4eed-bb53-2f4b52a517c5 None None] MFA Rules not processed for user `4920e5f3dcdc4b068f4a0b3a1f9bc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:00.006290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b0907308-2475-4eed-bb53-2f4b52a517c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:00.113226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 647/1310] 10.222.0.70 () {58 vars in 1061 bytes} [Mon May 16 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:00.113801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cd06a-daac-415a-b2d7-64963a1aa8d6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:00.116409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b50cd06a-daac-415a-b2d7-64963a1aa8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:00.238126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cd06a-daac-415a-b2d7-64963a1aa8d6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:00.311164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:00.312161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:00.312614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:00.313047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:00.314989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:00.424976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:00.426495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc799-6cd9-4961-9dbb-57c935933971 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:00.445808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 664/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:48:02.973044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b435c-6df3-489b-9296-9d2fa58b7667 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:02.973590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b435c-6df3-489b-9296-9d2fa58b7667 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:02.973590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b435c-6df3-489b-9296-9d2fa58b7667 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:02.977733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 648/1312] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:02.982402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec8b4-4cb5-43fc-99c9-6fb48ba2926e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:02.983856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec8b4-4cb5-43fc-99c9-6fb48ba2926e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:02.984476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec8b4-4cb5-43fc-99c9-6fb48ba2926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:03.069236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-336ec8b4-4cb5-43fc-99c9-6fb48ba2926e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:03.070512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-336ec8b4-4cb5-43fc-99c9-6fb48ba2926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:03.181778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 665/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:03.216630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b435c-6df3-489b-9296-9d2fa58b7667 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:03.218215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-784b435c-6df3-489b-9296-9d2fa58b7667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:03.327604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b435c-6df3-489b-9296-9d2fa58b7667 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:03.400308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:03.400856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:03.401149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:03.401408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:03.403068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:03.509636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:03.511338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a0541-7336-4d90-a30c-638c3e4f8e70 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:03.530416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 649/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:06.074252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664c35a-edca-41ea-b429-f7c59a886915 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:06.074770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664c35a-edca-41ea-b429-f7c59a886915 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:06.074925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664c35a-edca-41ea-b429-f7c59a886915 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:06.077005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 666/1315] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:06.082598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9e28-21e5-4819-aa61-9ef5a4617681 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:06.083045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9e28-21e5-4819-aa61-9ef5a4617681 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:06.083138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9e28-21e5-4819-aa61-9ef5a4617681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:06.144327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-28cb9e28-21e5-4819-aa61-9ef5a4617681 None None] MFA Rules not processed for user `052dcf7b71fa4cc0848daec5968ebb09`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:06.145524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-28cb9e28-21e5-4819-aa61-9ef5a4617681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:06.235706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 650/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:06.274827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664c35a-edca-41ea-b429-f7c59a886915 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:06.276364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9664c35a-edca-41ea-b429-f7c59a886915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:06.374834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664c35a-edca-41ea-b429-f7c59a886915 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:06.444295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:06.444938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:06.445214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:06.445483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:06.447138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:06.548235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:06.549672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539661f-a294-4645-9221-96acb307b66b service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:06.568757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 667/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:09.281519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7186f-5174-4101-adfd-63eb84908e47 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:09.282140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7186f-5174-4101-adfd-63eb84908e47 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:09.282140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7186f-5174-4101-adfd-63eb84908e47 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:09.283444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 651/1318] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:09.288546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907db47-9d94-4df8-8f65-8262500ea644 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:09.288978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907db47-9d94-4df8-8f65-8262500ea644 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:09.289123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907db47-9d94-4df8-8f65-8262500ea644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:09.352135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d907db47-9d94-4df8-8f65-8262500ea644 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:09.353334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d907db47-9d94-4df8-8f65-8262500ea644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:09.444821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 668/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:09.499004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cfc75-3a30-4c4f-89a2-426a5629f380 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:09.499284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cfc75-3a30-4c4f-89a2-426a5629f380 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:09.499573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cfc75-3a30-4c4f-89a2-426a5629f380 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:09.500915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 652/1320] 10.222.0.70 () {54 vars in 964 bytes} [Mon May 16 16:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:09.506905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292fcb-4643-4554-880b-067613284269 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:09.507193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292fcb-4643-4554-880b-067613284269 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:09.507467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292fcb-4643-4554-880b-067613284269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:09.578951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0d292fcb-4643-4554-880b-067613284269 None None] MFA Rules not processed for user `4920e5f3dcdc4b068f4a0b3a1f9bc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:09.580061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0d292fcb-4643-4554-880b-067613284269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:09.651594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 669/1321] 10.222.0.70 () {58 vars in 1061 bytes} [Mon May 16 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:09.660586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cfc75-3a30-4c4f-89a2-426a5629f380 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:09.662102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cd6cfc75-3a30-4c4f-89a2-426a5629f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:09.758741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cfc75-3a30-4c4f-89a2-426a5629f380 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:09.825311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:09.826510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:09.826785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:09.827051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:09.828642 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:09.928857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:09.930320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e913fef-ed9d-4f4d-9f03-0772f73f9f3b service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:09.948167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 653/1322] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:48:13.352034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90a5fe-0020-4423-97ae-6baf410246e0 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:13.352584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90a5fe-0020-4423-97ae-6baf410246e0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:13.352584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90a5fe-0020-4423-97ae-6baf410246e0 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:13.354108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 670/1323] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:13.359668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331186-39b7-458e-b869-d3d50c881317 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:13.360095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331186-39b7-458e-b869-d3d50c881317 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:13.360214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e331186-39b7-458e-b869-d3d50c881317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:13.422000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0e331186-39b7-458e-b869-d3d50c881317 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:13.423191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0e331186-39b7-458e-b869-d3d50c881317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:13.525046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 654/1324] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:13.561883 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90a5fe-0020-4423-97ae-6baf410246e0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:13.563407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0e90a5fe-0020-4423-97ae-6baf410246e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:13.662294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90a5fe-0020-4423-97ae-6baf410246e0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:13.733634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:13.734311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:13.734586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:13.734861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:13.736492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:13.842639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:13.844119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f15809-4ab9-42ca-baa1-9c829d2308f6 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:13.862260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 671/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:16.135968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38770-544c-48e3-b3ab-7be319e2895d None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:16.136579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38770-544c-48e3-b3ab-7be319e2895d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:16.136579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38770-544c-48e3-b3ab-7be319e2895d None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:16.137907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 655/1326] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:16.143091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd44de-aa20-4e58-a2ca-31cd89cd7cd4 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:16.143521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd44de-aa20-4e58-a2ca-31cd89cd7cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:16.143629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd44de-aa20-4e58-a2ca-31cd89cd7cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:16.204450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6dbd44de-aa20-4e58-a2ca-31cd89cd7cd4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:16.205613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6dbd44de-aa20-4e58-a2ca-31cd89cd7cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:16.296745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 672/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:16.331735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38770-544c-48e3-b3ab-7be319e2895d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:16.333238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-52d38770-544c-48e3-b3ab-7be319e2895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:16.432637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38770-544c-48e3-b3ab-7be319e2895d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:16.500720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:16.501357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:16.501634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:16.501929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:16.503521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:16.605545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:16.607286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee4adc-1049-4f68-b43f-b7e19ac87720 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:16.625515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 656/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:18.870437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcc6b-e8ed-4903-ba0a-bda886b0dbc5 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:18.870978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcc6b-e8ed-4903-ba0a-bda886b0dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:18.870978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fcc6b-e8ed-4903-ba0a-bda886b0dbc5 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:18.872393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 673/1329] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:18.877499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fbfa7-2972-4ada-9e02-b189c86e5858 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:18.877974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fbfa7-2972-4ada-9e02-b189c86e5858 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:18.878076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fbfa7-2972-4ada-9e02-b189c86e5858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:18.939429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-905fbfa7-2972-4ada-9e02-b189c86e5858 None None] MFA Rules not processed for user `052dcf7b71fa4cc0848daec5968ebb09`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:18.940601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-905fbfa7-2972-4ada-9e02-b189c86e5858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:19.033015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 657/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:19.069335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fcc6b-e8ed-4903-ba0a-bda886b0dbc5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:19.070916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ea5fcc6b-e8ed-4903-ba0a-bda886b0dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:19.172563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fcc6b-e8ed-4903-ba0a-bda886b0dbc5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:19.244084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:19.244725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:19.245001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:19.245268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:19.247002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:19.350989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:19.352464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8042ccf-6d1c-4050-8459-0bb0b65c1ec2 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:19.369830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 674/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:21.815731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca121-2348-4f4d-bfbb-1021b18a19b1 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:21.816257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca121-2348-4f4d-bfbb-1021b18a19b1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:21.816257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ca121-2348-4f4d-bfbb-1021b18a19b1 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:21.817627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 658/1332] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:21.823089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb9c4-9c34-4932-bd09-39b1b34940c6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:21.823592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb9c4-9c34-4932-bd09-39b1b34940c6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:21.823696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb9c4-9c34-4932-bd09-39b1b34940c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:21.891008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1ccdb9c4-9c34-4932-bd09-39b1b34940c6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:21.892208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1ccdb9c4-9c34-4932-bd09-39b1b34940c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:21.983217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 675/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:22.021047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ca121-2348-4f4d-bfbb-1021b18a19b1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:22.022586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-df2ca121-2348-4f4d-bfbb-1021b18a19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:22.128640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ca121-2348-4f4d-bfbb-1021b18a19b1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:22.198736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:22.199380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:22.199655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:22.199923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:22.201544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:22.303097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:22.304451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b7135-de89-493b-b3d2-8be022aaa09b service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:22.323297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 659/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:24.587889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b871-28a2-4f20-a5a8-c7a6818148ed None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:24.588477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b871-28a2-4f20-a5a8-c7a6818148ed None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:24.588477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b871-28a2-4f20-a5a8-c7a6818148ed None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:24.589817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 676/1335] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:24.595556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598120d-d1ef-4e9b-8e7c-82bdceaf4080 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:24.595984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598120d-d1ef-4e9b-8e7c-82bdceaf4080 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:24.596101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598120d-d1ef-4e9b-8e7c-82bdceaf4080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:24.656685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a598120d-d1ef-4e9b-8e7c-82bdceaf4080 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:24.657893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a598120d-d1ef-4e9b-8e7c-82bdceaf4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:24.747710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 660/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:24.786473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656b871-28a2-4f20-a5a8-c7a6818148ed None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:24.788002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f656b871-28a2-4f20-a5a8-c7a6818148ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:24.884539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656b871-28a2-4f20-a5a8-c7a6818148ed None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:24.953457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:24.954127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:24.954402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:24.954668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:24.956258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:25.058106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:25.060094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546460d-0e64-46f1-9a4f-14dc4a4bf521 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:25.079246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 677/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:27.636214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e70c-ab56-4c51-9822-2d6e10650ed6 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:27.636754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e70c-ab56-4c51-9822-2d6e10650ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:27.636754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32e70c-ab56-4c51-9822-2d6e10650ed6 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:27.638180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 661/1338] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:27.643597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768836-5b2d-4da5-b254-9e4c114578a8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:27.644045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768836-5b2d-4da5-b254-9e4c114578a8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:27.644147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768836-5b2d-4da5-b254-9e4c114578a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:27.705705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d7768836-5b2d-4da5-b254-9e4c114578a8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:27.706925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d7768836-5b2d-4da5-b254-9e4c114578a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:27.798802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 678/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:27.833546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e70c-ab56-4c51-9822-2d6e10650ed6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:27.835100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8b32e70c-ab56-4c51-9822-2d6e10650ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:27.937510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32e70c-ab56-4c51-9822-2d6e10650ed6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:28.007769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:28.008407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:28.008679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:28.008945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:28.010603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:28.115843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:28.117274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb074b4-669c-48c7-b948-1bf1fbac3623 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:28.135404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 662/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:32.261052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94a1a-107e-497a-a10c-97c97832680d None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:32.261636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94a1a-107e-497a-a10c-97c97832680d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:32.261636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94a1a-107e-497a-a10c-97c97832680d None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:32.263027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 679/1341] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:32.268391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48afbe-1c3b-49ae-866b-1578798a87cb None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:32.268801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48afbe-1c3b-49ae-866b-1578798a87cb None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:32.269053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48afbe-1c3b-49ae-866b-1578798a87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:32.337418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4a48afbe-1c3b-49ae-866b-1578798a87cb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:32.338626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4a48afbe-1c3b-49ae-866b-1578798a87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:32.439948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 663/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:32.478403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94a1a-107e-497a-a10c-97c97832680d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:32.480551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2ca94a1a-107e-497a-a10c-97c97832680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:32.573342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94a1a-107e-497a-a10c-97c97832680d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:32.576963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23376-91c9-4a51-bd00-e7da6dc19437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:32.577607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23376-91c9-4a51-bd00-e7da6dc19437 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:32.577916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23376-91c9-4a51-bd00-e7da6dc19437 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:32.578206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23376-91c9-4a51-bd00-e7da6dc19437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:32.587046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23376-91c9-4a51-bd00-e7da6dc19437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:32.588557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23376-91c9-4a51-bd00-e7da6dc19437 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:32.597749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 680/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:35.365551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f38b-59cf-4583-8ffb-a2d3ac01770b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:35.366147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f38b-59cf-4583-8ffb-a2d3ac01770b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:35.366147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f38b-59cf-4583-8ffb-a2d3ac01770b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:35.367805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 664/1344] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:35.374166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20754b5-91f9-451c-bb8f-96fddee14a5e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:35.374655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20754b5-91f9-451c-bb8f-96fddee14a5e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:35.375005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20754b5-91f9-451c-bb8f-96fddee14a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:35.402848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a20754b5-91f9-451c-bb8f-96fddee14a5e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:35.403932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a20754b5-91f9-451c-bb8f-96fddee14a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:35.477133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 681/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:35.514171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f38b-59cf-4583-8ffb-a2d3ac01770b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:35.524559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f38b-59cf-4583-8ffb-a2d3ac01770b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:35.528035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20853611-5b17-41d0-9279-2af99aad0990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:35.528662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853611-5b17-41d0-9279-2af99aad0990 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:35.528935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853611-5b17-41d0-9279-2af99aad0990 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:35.529201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20853611-5b17-41d0-9279-2af99aad0990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:35.537666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20853611-5b17-41d0-9279-2af99aad0990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:35.539128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20853611-5b17-41d0-9279-2af99aad0990 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:35.548688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 665/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:39.740598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc441-92f8-45db-b748-d61ee11b923e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:39.741118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc441-92f8-45db-b748-d61ee11b923e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:39.741118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc441-92f8-45db-b748-d61ee11b923e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:39.744131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 682/1347] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:39.749923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eab60e-87de-4b4f-a15c-9f9fe6e1ab10 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:39.750406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eab60e-87de-4b4f-a15c-9f9fe6e1ab10 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:39.750937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eab60e-87de-4b4f-a15c-9f9fe6e1ab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:39.768500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-03eab60e-87de-4b4f-a15c-9f9fe6e1ab10 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:39.769702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-03eab60e-87de-4b4f-a15c-9f9fe6e1ab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:39.777585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 666/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:39.814967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfc441-92f8-45db-b748-d61ee11b923e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:39.826676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfc441-92f8-45db-b748-d61ee11b923e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:39.830333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3721d6d-3336-44b4-962a-b8197ad5f90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:39.831208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721d6d-3336-44b4-962a-b8197ad5f90b service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:39.831337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721d6d-3336-44b4-962a-b8197ad5f90b service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:39.831664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3721d6d-3336-44b4-962a-b8197ad5f90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:39.841176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3721d6d-3336-44b4-962a-b8197ad5f90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:39.842729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3721d6d-3336-44b4-962a-b8197ad5f90b service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:39.852402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 683/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:48:45.154289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e437-dd8f-40ac-abf1-a950e297a8ea None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:45.154289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e437-dd8f-40ac-abf1-a950e297a8ea None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:45.154289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e437-dd8f-40ac-abf1-a950e297a8ea None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:45.154289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 667/1350] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:45.159386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e23570-f01c-4419-98b7-f355054b34bb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:45.159824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e23570-f01c-4419-98b7-f355054b34bb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:45.159920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e23570-f01c-4419-98b7-f355054b34bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:45.273312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d0e23570-f01c-4419-98b7-f355054b34bb None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:45.273991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d0e23570-f01c-4419-98b7-f355054b34bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:45.366005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 684/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:49.883756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7de8c-be40-4abf-bc1b-1dc4a6d664ec None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:49.884273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7de8c-be40-4abf-bc1b-1dc4a6d664ec None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:49.884273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7de8c-be40-4abf-bc1b-1dc4a6d664ec None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:49.885896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 668/1352] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:49.891501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f8314-1440-4de3-9e06-9dbc3cf8dafb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:49.892057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f8314-1440-4de3-9e06-9dbc3cf8dafb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:49.892282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f8314-1440-4de3-9e06-9dbc3cf8dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:49.913440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0c4f8314-1440-4de3-9e06-9dbc3cf8dafb None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:49.914837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0c4f8314-1440-4de3-9e06-9dbc3cf8dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:49.924581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 685/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:48:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:51.325956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c9af-1fc0-4747-bcbe-405f4bc77224 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:51.326566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c9af-1fc0-4747-bcbe-405f4bc77224 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:51.326566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592c9af-1fc0-4747-bcbe-405f4bc77224 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:51.328003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 669/1354] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:51.332719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aff3b-5008-4c9e-9b5e-1eba3ba6b8a5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:51.333147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aff3b-5008-4c9e-9b5e-1eba3ba6b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:51.333302 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aff3b-5008-4c9e-9b5e-1eba3ba6b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:51.351125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f19aff3b-5008-4c9e-9b5e-1eba3ba6b8a5 None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:51.352303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f19aff3b-5008-4c9e-9b5e-1eba3ba6b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:51.361814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 686/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:55.095275 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1e71-9b68-41a4-8d6d-582feb76c944 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:55.095848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1e71-9b68-41a4-8d6d-582feb76c944 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:55.096077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b1e71-9b68-41a4-8d6d-582feb76c944 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:55.097714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 670/1356] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:55.102988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d11524-83a8-458d-8d08-2fc252747756 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:55.103410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d11524-83a8-458d-8d08-2fc252747756 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:55.103532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d11524-83a8-458d-8d08-2fc252747756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:55.121333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f8d11524-83a8-458d-8d08-2fc252747756 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:55.122539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f8d11524-83a8-458d-8d08-2fc252747756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:55.130505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 687/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:55.179161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1a87-b9bd-4529-a781-24b53b5ec7a5 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:55.179590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1a87-b9bd-4529-a781-24b53b5ec7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:55.180108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1a87-b9bd-4529-a781-24b53b5ec7a5 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:55.182114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 671/1358] 10.222.0.70 () {54 vars in 961 bytes} [Mon May 16 16:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:55.187308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136ac7-79ea-4686-8410-3c52d665e062 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:55.187665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136ac7-79ea-4686-8410-3c52d665e062 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:55.188048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04136ac7-79ea-4686-8410-3c52d665e062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:55.235925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-04136ac7-79ea-4686-8410-3c52d665e062 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:55.237228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-04136ac7-79ea-4686-8410-3c52d665e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:55.329695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 688/1359] 10.222.0.70 () {58 vars in 1058 bytes} [Mon May 16 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:55.338260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e1a87-b9bd-4529-a781-24b53b5ec7a5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:55.353111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e1a87-b9bd-4529-a781-24b53b5ec7a5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:55.359053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c70c9-bcb5-4472-81ee-e0512f776fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:55.359678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c70c9-bcb5-4472-81ee-e0512f776fbc service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:55.359948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c70c9-bcb5-4472-81ee-e0512f776fbc service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:55.360375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c70c9-bcb5-4472-81ee-e0512f776fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:55.368391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c70c9-bcb5-4472-81ee-e0512f776fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:55.370016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c70c9-bcb5-4472-81ee-e0512f776fbc service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:55.380303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 672/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:48:57.816671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f398a6-1e3c-412d-9278-ceef72ed9711 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:57.817264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f398a6-1e3c-412d-9278-ceef72ed9711 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:57.817264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f398a6-1e3c-412d-9278-ceef72ed9711 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:57.818585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 689/1361] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:48:57.824182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8592ab-67fa-4e22-92e8-94a05d1d8565 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:57.824619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8592ab-67fa-4e22-92e8-94a05d1d8565 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:57.824725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8592ab-67fa-4e22-92e8-94a05d1d8565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:57.842766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-cf8592ab-67fa-4e22-92e8-94a05d1d8565 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:48:57.843941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cf8592ab-67fa-4e22-92e8-94a05d1d8565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:48:57.851589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 673/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:48:57.895675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f398a6-1e3c-412d-9278-ceef72ed9711 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:48:57.910644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f398a6-1e3c-412d-9278-ceef72ed9711 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:48:57.915975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dffd6-1244-4de1-93b9-3199b91213d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:48:57.916609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dffd6-1244-4de1-93b9-3199b91213d0 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:48:57.916893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dffd6-1244-4de1-93b9-3199b91213d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:48:57.917146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dffd6-1244-4de1-93b9-3199b91213d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:48:57.926777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dffd6-1244-4de1-93b9-3199b91213d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:48:57.928430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dffd6-1244-4de1-93b9-3199b91213d0 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:48:57.945714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 690/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:00.534196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bcd68-c861-481b-9b3f-aab9b6685438 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:00.534691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bcd68-c861-481b-9b3f-aab9b6685438 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:00.534789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bcd68-c861-481b-9b3f-aab9b6685438 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:00.536100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 674/1364] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:00.541378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297dd4-76bf-41bd-a2f0-acc933730a0e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:00.541869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297dd4-76bf-41bd-a2f0-acc933730a0e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:00.542018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c297dd4-76bf-41bd-a2f0-acc933730a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:00.559528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5c297dd4-76bf-41bd-a2f0-acc933730a0e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:00.560694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5c297dd4-76bf-41bd-a2f0-acc933730a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:00.568419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 691/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:00.614887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f795-ce69-4fcd-af7e-5802764969d0 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:00.615526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f795-ce69-4fcd-af7e-5802764969d0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:00.616031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06f795-ce69-4fcd-af7e-5802764969d0 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:00.617634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 675/1366] 10.222.0.70 () {54 vars in 961 bytes} [Mon May 16 16:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:00.629565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c498-edb1-4b5d-ac25-3e63c78b99bf None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:00.629565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c498-edb1-4b5d-ac25-3e63c78b99bf None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:00.629565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8c498-edb1-4b5d-ac25-3e63c78b99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:00.648785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b1e8c498-edb1-4b5d-ac25-3e63c78b99bf None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:00.650044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b1e8c498-edb1-4b5d-ac25-3e63c78b99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:00.659913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 692/1367] 10.222.0.70 () {58 vars in 1058 bytes} [Mon May 16 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:00.667712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06f795-ce69-4fcd-af7e-5802764969d0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:00.681779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06f795-ce69-4fcd-af7e-5802764969d0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:00.687759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344d988-65e8-47dd-b966-f45ea64057d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:00.688386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d988-65e8-47dd-b966-f45ea64057d6 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:00.688853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d988-65e8-47dd-b966-f45ea64057d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:00.689126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344d988-65e8-47dd-b966-f45ea64057d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:00.696981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d988-65e8-47dd-b966-f45ea64057d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:00.698605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344d988-65e8-47dd-b966-f45ea64057d6 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:00.708512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 676/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:02.994729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628f6a-74aa-4f01-b6dc-eb59d8fba28b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:02.995235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628f6a-74aa-4f01-b6dc-eb59d8fba28b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:02.995336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db628f6a-74aa-4f01-b6dc-eb59d8fba28b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:02.997210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 693/1369] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:03.002806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da325a-54b0-4442-8feb-343dab2d804f None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.003289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da325a-54b0-4442-8feb-343dab2d804f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.003370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da325a-54b0-4442-8feb-343dab2d804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.022953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-65da325a-54b0-4442-8feb-343dab2d804f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:03.024152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-65da325a-54b0-4442-8feb-343dab2d804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:03.032230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 677/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:03.077401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628f6a-74aa-4f01-b6dc-eb59d8fba28b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:03.092287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db628f6a-74aa-4f01-b6dc-eb59d8fba28b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:03.098073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f6126-c8b7-415a-98c0-643ad7fb7ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:03.098849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f6126-c8b7-415a-98c0-643ad7fb7ac5 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.099236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f6126-c8b7-415a-98c0-643ad7fb7ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.099658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f6126-c8b7-415a-98c0-643ad7fb7ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.109322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f6126-c8b7-415a-98c0-643ad7fb7ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:03.111201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f6126-c8b7-415a-98c0-643ad7fb7ac5 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:03.122897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 694/1371] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:03.299975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad98bfe-2efa-486f-b105-799535ee290a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.300517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad98bfe-2efa-486f-b105-799535ee290a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.300791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad98bfe-2efa-486f-b105-799535ee290a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.302398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 678/1372] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 16 16:49:03.307971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db8e2-b063-438c-a4e5-1826d01a9aa3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.308252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db8e2-b063-438c-a4e5-1826d01a9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.308759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db8e2-b063-438c-a4e5-1826d01a9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.328130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d15db8e2-b063-438c-a4e5-1826d01a9aa3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:03.329578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d15db8e2-b063-438c-a4e5-1826d01a9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:03.337731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 695/1373] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:49:03.651961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631883b7-3283-46fa-ab2c-4b60c0df8b5d None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.651961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631883b7-3283-46fa-ab2c-4b60c0df8b5d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.651961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631883b7-3283-46fa-ab2c-4b60c0df8b5d None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.653942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 679/1374] 10.222.0.70 () {54 vars in 963 bytes} [Mon May 16 16:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:03.657330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63600-986a-490f-a04b-513d68a86fcb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.657713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63600-986a-490f-a04b-513d68a86fcb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.658143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63600-986a-490f-a04b-513d68a86fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.710389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-98b63600-986a-490f-a04b-513d68a86fcb None None] MFA Rules not processed for user `c3d39e375e994373b5bd403baa053e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:03.711889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-98b63600-986a-490f-a04b-513d68a86fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:03.771796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 696/1375] 10.222.0.70 () {58 vars in 1060 bytes} [Mon May 16 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:03.779864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631883b7-3283-46fa-ab2c-4b60c0df8b5d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:03.790297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631883b7-3283-46fa-ab2c-4b60c0df8b5d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:03.794526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d992-ac37-4526-b8f9-e4b2e6736b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:03.795267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d992-ac37-4526-b8f9-e4b2e6736b80 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:03.795642 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d992-ac37-4526-b8f9-e4b2e6736b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:03.796014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d992-ac37-4526-b8f9-e4b2e6736b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:03.805063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d992-ac37-4526-b8f9-e4b2e6736b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:03.806775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d992-ac37-4526-b8f9-e4b2e6736b80 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:03.816413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 680/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:05.377853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8263c9-f524-415e-8ead-337f56db377e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:05.378452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8263c9-f524-415e-8ead-337f56db377e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:05.378452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8263c9-f524-415e-8ead-337f56db377e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:05.379773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 697/1377] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:05.385625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef535-dcc4-43ff-93e6-b62c391b00fd None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:05.386155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef535-dcc4-43ff-93e6-b62c391b00fd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:05.386366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ef535-dcc4-43ff-93e6-b62c391b00fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:05.405472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-052ef535-dcc4-43ff-93e6-b62c391b00fd None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:05.406972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-052ef535-dcc4-43ff-93e6-b62c391b00fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:05.416125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 681/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:05.460720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8263c9-f524-415e-8ead-337f56db377e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:05.475734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8263c9-f524-415e-8ead-337f56db377e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:05.482034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb888de8-7a43-4e28-8202-3ba144195992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:05.482693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888de8-7a43-4e28-8202-3ba144195992 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:05.482969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888de8-7a43-4e28-8202-3ba144195992 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:05.483235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb888de8-7a43-4e28-8202-3ba144195992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:05.492117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888de8-7a43-4e28-8202-3ba144195992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:05.493733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb888de8-7a43-4e28-8202-3ba144195992 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:05.504524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 698/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:07.760831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95515-559e-459a-82a9-6c62076f6f1e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:07.761996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95515-559e-459a-82a9-6c62076f6f1e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:07.761996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95515-559e-459a-82a9-6c62076f6f1e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:07.763295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 682/1380] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:07.768888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aea89-b310-401e-8938-44cc76f97840 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:07.769319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aea89-b310-401e-8938-44cc76f97840 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:07.769482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aea89-b310-401e-8938-44cc76f97840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:07.788649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-344aea89-b310-401e-8938-44cc76f97840 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:07.789924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-344aea89-b310-401e-8938-44cc76f97840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:07.798155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 699/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:07.841203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95515-559e-459a-82a9-6c62076f6f1e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:07.855144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95515-559e-459a-82a9-6c62076f6f1e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:07.860697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac585-2c8c-4842-a57d-5f35e580220d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:07.861328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac585-2c8c-4842-a57d-5f35e580220d service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:07.861603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac585-2c8c-4842-a57d-5f35e580220d service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:07.861904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac585-2c8c-4842-a57d-5f35e580220d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:07.869959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac585-2c8c-4842-a57d-5f35e580220d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:07.871570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac585-2c8c-4842-a57d-5f35e580220d service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:07.880976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 683/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:10.138862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb888d4-4950-492e-acaa-5fdd82abe105 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:10.139454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb888d4-4950-492e-acaa-5fdd82abe105 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:10.139454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb888d4-4950-492e-acaa-5fdd82abe105 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:10.140753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 700/1383] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:10.146314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4d11-f00c-4af3-bd19-8aad13d54634 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:10.146786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4d11-f00c-4af3-bd19-8aad13d54634 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:10.146893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4d11-f00c-4af3-bd19-8aad13d54634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:10.165079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b3ff4d11-f00c-4af3-bd19-8aad13d54634 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:10.166290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b3ff4d11-f00c-4af3-bd19-8aad13d54634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:10.174560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 684/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:10.217805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb888d4-4950-492e-acaa-5fdd82abe105 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:10.235801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb888d4-4950-492e-acaa-5fdd82abe105 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:10.241866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa24160-e2f2-4a6e-a97b-312e3c260b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:10.242554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24160-e2f2-4a6e-a97b-312e3c260b65 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:10.242834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24160-e2f2-4a6e-a97b-312e3c260b65 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:10.243104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa24160-e2f2-4a6e-a97b-312e3c260b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:10.254445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24160-e2f2-4a6e-a97b-312e3c260b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:10.256116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa24160-e2f2-4a6e-a97b-312e3c260b65 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:10.268604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 701/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:12.722697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55b2f-faad-43ff-be04-b26b65e2cf55 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:12.723372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55b2f-faad-43ff-be04-b26b65e2cf55 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:12.723372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55b2f-faad-43ff-be04-b26b65e2cf55 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:12.725088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 685/1386] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:12.732747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdb19b-13ec-4376-be2e-32d6a7eda31c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:12.733273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdb19b-13ec-4376-be2e-32d6a7eda31c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:12.733412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdb19b-13ec-4376-be2e-32d6a7eda31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:12.754619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-bdfdb19b-13ec-4376-be2e-32d6a7eda31c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:12.756368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bdfdb19b-13ec-4376-be2e-32d6a7eda31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:12.765959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 702/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:12.813116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55b2f-faad-43ff-be04-b26b65e2cf55 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:12.827715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55b2f-faad-43ff-be04-b26b65e2cf55 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:12.833485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde2936-4895-4130-85b6-93b9de1c2990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:12.834155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2936-4895-4130-85b6-93b9de1c2990 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:12.834457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2936-4895-4130-85b6-93b9de1c2990 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:12.834719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde2936-4895-4130-85b6-93b9de1c2990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:12.843852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde2936-4895-4130-85b6-93b9de1c2990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:12.845549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde2936-4895-4130-85b6-93b9de1c2990 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:12.856318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 686/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:15.156870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62484-a56e-442d-8711-44f5a3b5a188 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:15.157492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62484-a56e-442d-8711-44f5a3b5a188 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:15.157666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62484-a56e-442d-8711-44f5a3b5a188 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:15.159458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 703/1389] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:15.165968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed660-4b1d-4a30-8159-96611efd7116 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:15.166434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed660-4b1d-4a30-8159-96611efd7116 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:15.166574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed660-4b1d-4a30-8159-96611efd7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:15.184813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-943ed660-4b1d-4a30-8159-96611efd7116 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:15.186045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-943ed660-4b1d-4a30-8159-96611efd7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:15.194125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 687/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:15.247366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62484-a56e-442d-8711-44f5a3b5a188 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:15.262880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62484-a56e-442d-8711-44f5a3b5a188 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:15.268671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f83ad-d7a2-4e00-95ee-cff5e2e2b7a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:15.269307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f83ad-d7a2-4e00-95ee-cff5e2e2b7a9 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:15.269589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f83ad-d7a2-4e00-95ee-cff5e2e2b7a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:15.269897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f83ad-d7a2-4e00-95ee-cff5e2e2b7a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:15.278555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f83ad-d7a2-4e00-95ee-cff5e2e2b7a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:15.280340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f83ad-d7a2-4e00-95ee-cff5e2e2b7a9 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:15.290872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 704/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:17.630041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73660-59dc-4ea7-88a5-251af6a96c1e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:17.630684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73660-59dc-4ea7-88a5-251af6a96c1e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:17.630684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73660-59dc-4ea7-88a5-251af6a96c1e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:17.631966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 688/1392] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:17.637596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2247-2398-4803-a447-c459918aa1d0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:17.638064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2247-2398-4803-a447-c459918aa1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:17.638285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2247-2398-4803-a447-c459918aa1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:17.656107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-280b2247-2398-4803-a447-c459918aa1d0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:17.657258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-280b2247-2398-4803-a447-c459918aa1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:17.665044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 705/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:17.708371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73660-59dc-4ea7-88a5-251af6a96c1e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:17.723213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73660-59dc-4ea7-88a5-251af6a96c1e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:17.728489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d40cc0-c591-4ec0-a0b3-ec07d27be39f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:17.729116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40cc0-c591-4ec0-a0b3-ec07d27be39f service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:17.729386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40cc0-c591-4ec0-a0b3-ec07d27be39f service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:17.729653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d40cc0-c591-4ec0-a0b3-ec07d27be39f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:17.737853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d40cc0-c591-4ec0-a0b3-ec07d27be39f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:17.739428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d40cc0-c591-4ec0-a0b3-ec07d27be39f service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:17.748567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 689/1394] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:19.410085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0336c-fbd9-4002-a710-1f877547da93 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:19.411118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0336c-fbd9-4002-a710-1f877547da93 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:19.411404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0336c-fbd9-4002-a710-1f877547da93 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:19.412822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 706/1395] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:19.419047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e115-c5ea-419f-af9e-9c9f424230a3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:19.419499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e115-c5ea-419f-af9e-9c9f424230a3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:19.419713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e115-c5ea-419f-af9e-9c9f424230a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:19.436880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b197e115-c5ea-419f-af9e-9c9f424230a3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:19.438084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b197e115-c5ea-419f-af9e-9c9f424230a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:19.445696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 690/1396] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:19.501092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88021e22-a66a-4530-89e9-c45ed07afd84 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:19.501373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88021e22-a66a-4530-89e9-c45ed07afd84 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:19.501644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88021e22-a66a-4530-89e9-c45ed07afd84 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:19.503016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 707/1397] 10.222.0.70 () {54 vars in 962 bytes} [Mon May 16 16:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:19.507825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6aa0-79cb-404c-b69b-4a994dd7b8fc None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:19.508106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6aa0-79cb-404c-b69b-4a994dd7b8fc None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:19.508383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6aa0-79cb-404c-b69b-4a994dd7b8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:19.554214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-aa6d6aa0-79cb-404c-b69b-4a994dd7b8fc None None] MFA Rules not processed for user `9e3e792f55154143932d62ac460022b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:19.555386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-aa6d6aa0-79cb-404c-b69b-4a994dd7b8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:19.612014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 691/1398] 10.222.0.70 () {58 vars in 1059 bytes} [Mon May 16 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:19.619409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88021e22-a66a-4530-89e9-c45ed07afd84 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:19.629775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88021e22-a66a-4530-89e9-c45ed07afd84 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:19.633221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2496b-d02e-45f0-83fc-3e6bf53ef298 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:19.633887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2496b-d02e-45f0-83fc-3e6bf53ef298 service glance] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:19.634166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2496b-d02e-45f0-83fc-3e6bf53ef298 service glance] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:19.634455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2496b-d02e-45f0-83fc-3e6bf53ef298 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:19.643137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2496b-d02e-45f0-83fc-3e6bf53ef298 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:19.644572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2496b-d02e-45f0-83fc-3e6bf53ef298 service glance] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:19.654479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 708/1399] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:20.001284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f662-aae7-48b8-9a62-79cb0e27069c None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.001564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f662-aae7-48b8-9a62-79cb0e27069c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.001956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f662-aae7-48b8-9a62-79cb0e27069c None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.003378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 692/1400] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:20.008792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.009072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.009343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.027807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:20.028997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:20.037135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 709/1401] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:20.066201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d61cb-4248-4ce7-8c49-8eab6c1d9772 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.066558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d61cb-4248-4ce7-8c49-8eab6c1d9772 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.066834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d61cb-4248-4ce7-8c49-8eab6c1d9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.081022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:20.093348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3bbe1-2df7-4fb7-948d-84756a8af936 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:20.098795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f781cd6-e352-45cf-b7d1-950331fafaae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:20.099427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781cd6-e352-45cf-b7d1-950331fafaae service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.099704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781cd6-e352-45cf-b7d1-950331fafaae service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.099978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781cd6-e352-45cf-b7d1-950331fafaae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.108486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f781cd6-e352-45cf-b7d1-950331fafaae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:20.110309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f781cd6-e352-45cf-b7d1-950331fafaae service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:20.114197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-920d61cb-4248-4ce7-8c49-8eab6c1d9772 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:20.115388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-920d61cb-4248-4ce7-8c49-8eab6c1d9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:20.119699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 710/1402] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:49:20.177873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 693/1403] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:20.222092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a1eb-42f0-440d-a834-88fd9c774b92 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.222378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a1eb-42f0-440d-a834-88fd9c774b92 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.222647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a1eb-42f0-440d-a834-88fd9c774b92 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.224048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 711/1404] 10.222.0.70 () {54 vars in 942 bytes} [Mon May 16 16:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:20.231515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b884c-824e-483e-9ef0-ea6962bd434c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.231826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b884c-824e-483e-9ef0-ea6962bd434c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.232118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b884c-824e-483e-9ef0-ea6962bd434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.285646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-379b884c-824e-483e-9ef0-ea6962bd434c None None] MFA Rules not processed for user `15960410c990447c9773da8ae5be7cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:20.286801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-379b884c-824e-483e-9ef0-ea6962bd434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:20.490761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 694/1405] 10.222.0.70 () {58 vars in 1039 bytes} [Mon May 16 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:20.500488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a1eb-42f0-440d-a834-88fd9c774b92 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:20.514259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a1eb-42f0-440d-a834-88fd9c774b92 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:20.519343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a4ec6-466e-4634-9dfa-f716bee4272d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:20.520023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4ec6-466e-4634-9dfa-f716bee4272d service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:20.520301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4ec6-466e-4634-9dfa-f716bee4272d service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:20.520567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a4ec6-466e-4634-9dfa-f716bee4272d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:20.528722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a4ec6-466e-4634-9dfa-f716bee4272d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:20.530587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a4ec6-466e-4634-9dfa-f716bee4272d service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:20.538596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 712/1406] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 16:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 16:49:22.409920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b3cb-043f-446e-b768-4346bcb58391 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:22.410487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b3cb-043f-446e-b768-4346bcb58391 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:22.410487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b3cb-043f-446e-b768-4346bcb58391 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:22.411901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 695/1407] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:22.419294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bbc2-e259-41f7-901e-436f5ab83145 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:22.419294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bbc2-e259-41f7-901e-436f5ab83145 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:22.419294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81bbc2-e259-41f7-901e-436f5ab83145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:22.438390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9b81bbc2-e259-41f7-901e-436f5ab83145 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:22.439852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9b81bbc2-e259-41f7-901e-436f5ab83145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:22.447986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 713/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:22.494550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0b3cb-043f-446e-b768-4346bcb58391 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:22.510843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0b3cb-043f-446e-b768-4346bcb58391 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:22.516256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba316c9a-0b7a-4899-8bde-776d296a2b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:22.516966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba316c9a-0b7a-4899-8bde-776d296a2b60 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:22.517307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba316c9a-0b7a-4899-8bde-776d296a2b60 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:22.517639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba316c9a-0b7a-4899-8bde-776d296a2b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:22.528342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba316c9a-0b7a-4899-8bde-776d296a2b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:22.530053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba316c9a-0b7a-4899-8bde-776d296a2b60 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:22.540414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 696/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:44.034782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e334-aa3c-446b-aa2b-880962c2cb2d None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:44.035388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e334-aa3c-446b-aa2b-880962c2cb2d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:44.035388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e334-aa3c-446b-aa2b-880962c2cb2d None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:44.036628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 714/1410] 10.222.0.70 () {54 vars in 918 bytes} [Mon May 16 16:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:44.042428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c4c2-bee9-4f57-a7c6-719df1470da6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:44.042886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c4c2-bee9-4f57-a7c6-719df1470da6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:44.042988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c4c2-bee9-4f57-a7c6-719df1470da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:44.060547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ae42c4c2-bee9-4f57-a7c6-719df1470da6 None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:44.061724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ae42c4c2-bee9-4f57-a7c6-719df1470da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:44.070039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 697/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Mon May 16 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:44.084137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920accb-4f27-442b-80af-09c5b9005713 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:44.084421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920accb-4f27-442b-80af-09c5b9005713 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:44.084696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920accb-4f27-442b-80af-09c5b9005713 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:44.086061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 715/1412] 10.222.0.70 () {54 vars in 918 bytes} [Mon May 16 16:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:44.090579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af38e-be4e-478c-ab07-f45582c19598 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:44.090862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af38e-be4e-478c-ab07-f45582c19598 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:44.091164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af38e-be4e-478c-ab07-f45582c19598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:44.108555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1d3af38e-be4e-478c-ab07-f45582c19598 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:44.109748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1d3af38e-be4e-478c-ab07-f45582c19598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:44.118739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 698/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Mon May 16 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:46.810918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58429-d1a6-4ea8-ac78-73b28b6fe112 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:46.811483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58429-d1a6-4ea8-ac78-73b28b6fe112 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:46.811483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58429-d1a6-4ea8-ac78-73b28b6fe112 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:46.812763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:46.818185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1da9-a099-45c8-8262-01056d313362 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:46.818631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1da9-a099-45c8-8262-01056d313362 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:46.818743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c1da9-a099-45c8-8262-01056d313362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:46.835697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5a3c1da9-a099-45c8-8262-01056d313362 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:46.836869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5a3c1da9-a099-45c8-8262-01056d313362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:46.844506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:46.885957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58429-d1a6-4ea8-ac78-73b28b6fe112 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:46.899751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58429-d1a6-4ea8-ac78-73b28b6fe112 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:46.905064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d7e59-17bd-4c07-b2f5-8daa5e00e427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:46.905691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d7e59-17bd-4c07-b2f5-8daa5e00e427 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:46.905993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d7e59-17bd-4c07-b2f5-8daa5e00e427 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:46.906264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d7e59-17bd-4c07-b2f5-8daa5e00e427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:46.914074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d7e59-17bd-4c07-b2f5-8daa5e00e427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:46.915653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d7e59-17bd-4c07-b2f5-8daa5e00e427 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:46.925185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 717/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:47.899509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767bebf-e242-49fd-b8a9-1cb7a237949f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:47.900121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767bebf-e242-49fd-b8a9-1cb7a237949f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:47.900121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767bebf-e242-49fd-b8a9-1cb7a237949f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:47.901992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:47.906758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3992-8338-4638-bc57-143fc938c13f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:47.907195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3992-8338-4638-bc57-143fc938c13f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:47.907308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd3992-8338-4638-bc57-143fc938c13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:47.925438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5cfd3992-8338-4638-bc57-143fc938c13f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:47.926662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5cfd3992-8338-4638-bc57-143fc938c13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:47.934970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:48.101689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767bebf-e242-49fd-b8a9-1cb7a237949f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:48.115651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767bebf-e242-49fd-b8a9-1cb7a237949f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:48.121287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9efc00-7ef3-4071-9b68-d7580040bb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:48.121933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9efc00-7ef3-4071-9b68-d7580040bb10 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:48.122206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9efc00-7ef3-4071-9b68-d7580040bb10 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:48.122467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9efc00-7ef3-4071-9b68-d7580040bb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:48.130078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9efc00-7ef3-4071-9b68-d7580040bb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:48.131634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9efc00-7ef3-4071-9b68-d7580040bb10 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:48.141176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 701/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:49.086118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591320-4d78-4acd-8737-0fc34e86e926 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:49.086730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591320-4d78-4acd-8737-0fc34e86e926 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:49.086730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591320-4d78-4acd-8737-0fc34e86e926 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:49.088017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:49.092893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59374-9787-4b91-9e76-779eb446598d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:49.093361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59374-9787-4b91-9e76-779eb446598d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:49.093480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59374-9787-4b91-9e76-779eb446598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:49.111468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5de59374-9787-4b91-9e76-779eb446598d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:49.112666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5de59374-9787-4b91-9e76-779eb446598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:49.120832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:49.267991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591320-4d78-4acd-8737-0fc34e86e926 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:49.282352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591320-4d78-4acd-8737-0fc34e86e926 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:49.287825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d611b-7d0b-4642-bdad-84827a03e742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:49.288458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d611b-7d0b-4642-bdad-84827a03e742 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:49.288731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d611b-7d0b-4642-bdad-84827a03e742 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:49.289000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d611b-7d0b-4642-bdad-84827a03e742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:49.298190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d611b-7d0b-4642-bdad-84827a03e742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:49.299797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d611b-7d0b-4642-bdad-84827a03e742 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:49.313918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 720/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:50.238742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b02aa-3a07-4c05-b6d5-b7a87333bc3a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:50.239320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b02aa-3a07-4c05-b6d5-b7a87333bc3a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:50.239320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b02aa-3a07-4c05-b6d5-b7a87333bc3a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:50.240658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:50.246312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf00ad-2a9a-4b7b-ba05-8b931e25fadb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:50.246733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf00ad-2a9a-4b7b-ba05-8b931e25fadb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:50.246877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf00ad-2a9a-4b7b-ba05-8b931e25fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:50.264695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2ebf00ad-2a9a-4b7b-ba05-8b931e25fadb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:50.265903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2ebf00ad-2a9a-4b7b-ba05-8b931e25fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:50.273471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:50.420785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b02aa-3a07-4c05-b6d5-b7a87333bc3a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:50.436245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b02aa-3a07-4c05-b6d5-b7a87333bc3a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:50.441486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6d3e2-929b-4e6a-b55a-991a8ba0b9d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:50.442149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d3e2-929b-4e6a-b55a-991a8ba0b9d1 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:50.442421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d3e2-929b-4e6a-b55a-991a8ba0b9d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:50.442683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6d3e2-929b-4e6a-b55a-991a8ba0b9d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:50.451419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6d3e2-929b-4e6a-b55a-991a8ba0b9d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:50.453019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6d3e2-929b-4e6a-b55a-991a8ba0b9d1 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:50.461960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 704/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:51.373436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97477b8d-7a6d-4ee7-90e7-077f07e83b9e None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:51.374088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97477b8d-7a6d-4ee7-90e7-077f07e83b9e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:51.374088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97477b8d-7a6d-4ee7-90e7-077f07e83b9e None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:51.375355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:51.380369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03401ff6-d880-489a-844e-149c087f63eb None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:51.380780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03401ff6-d880-489a-844e-149c087f63eb None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:51.381048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03401ff6-d880-489a-844e-149c087f63eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:51.398744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-03401ff6-d880-489a-844e-149c087f63eb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:51.399914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-03401ff6-d880-489a-844e-149c087f63eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:51.408654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:51.556300 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97477b8d-7a6d-4ee7-90e7-077f07e83b9e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:51.570131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97477b8d-7a6d-4ee7-90e7-077f07e83b9e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:51.575939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afbaa1-6791-4d0e-b2b3-07b9f95d92cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:51.576556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afbaa1-6791-4d0e-b2b3-07b9f95d92cf service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:51.576830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afbaa1-6791-4d0e-b2b3-07b9f95d92cf service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:51.577098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afbaa1-6791-4d0e-b2b3-07b9f95d92cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:51.584806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afbaa1-6791-4d0e-b2b3-07b9f95d92cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:51.586406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afbaa1-6791-4d0e-b2b3-07b9f95d92cf service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:51.595984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 723/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:52.454156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03bcc-3d15-40ea-ad82-fb13d58652ee None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:52.454686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03bcc-3d15-40ea-ad82-fb13d58652ee None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:52.454686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03bcc-3d15-40ea-ad82-fb13d58652ee None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:52.456047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:52.461038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e306-3cf5-466f-891d-4c32eb820223 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:52.461493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e306-3cf5-466f-891d-4c32eb820223 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:52.461597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e306-3cf5-466f-891d-4c32eb820223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:52.479341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-dd19e306-3cf5-466f-891d-4c32eb820223 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:52.480506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dd19e306-3cf5-466f-891d-4c32eb820223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:52.488718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:52.644282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03bcc-3d15-40ea-ad82-fb13d58652ee None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:52.658479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03bcc-3d15-40ea-ad82-fb13d58652ee None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:52.663706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30367f-e939-430b-adfc-525affa36d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:52.664264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30367f-e939-430b-adfc-525affa36d52 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:52.664538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30367f-e939-430b-adfc-525affa36d52 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:52.664826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30367f-e939-430b-adfc-525affa36d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:52.673395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30367f-e939-430b-adfc-525affa36d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:52.675133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30367f-e939-430b-adfc-525affa36d52 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:52.684048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 707/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:53.553053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810236e4-9527-48f2-8ca8-8255038d726a None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:53.553610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810236e4-9527-48f2-8ca8-8255038d726a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:53.553610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810236e4-9527-48f2-8ca8-8255038d726a None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:53.555024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:53.560371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c29c-ffa1-42a1-a6f8-bc263fffdac7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:53.560793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c29c-ffa1-42a1-a6f8-bc263fffdac7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:53.560927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c29c-ffa1-42a1-a6f8-bc263fffdac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:53.578302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5290c29c-ffa1-42a1-a6f8-bc263fffdac7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:53.579483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5290c29c-ffa1-42a1-a6f8-bc263fffdac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:53.587199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:53.736391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810236e4-9527-48f2-8ca8-8255038d726a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:53.751024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810236e4-9527-48f2-8ca8-8255038d726a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:53.756301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fe58-be07-4d58-9ea8-86b05366e9c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:53.756926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fe58-be07-4d58-9ea8-86b05366e9c0 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:53.757201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fe58-be07-4d58-9ea8-86b05366e9c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:53.757469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fe58-be07-4d58-9ea8-86b05366e9c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:53.765358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782fe58-be07-4d58-9ea8-86b05366e9c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:53.766967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782fe58-be07-4d58-9ea8-86b05366e9c0 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:53.776038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 726/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:54.637931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9676-e1e6-4f90-a3e6-69e31c979923 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:54.638505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9676-e1e6-4f90-a3e6-69e31c979923 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:54.638505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e9676-e1e6-4f90-a3e6-69e31c979923 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:54.639826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:54.644659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764ada5-22f6-49b3-bf50-d81e98d60921 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:54.645073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764ada5-22f6-49b3-bf50-d81e98d60921 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:54.645207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764ada5-22f6-49b3-bf50-d81e98d60921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:54.662540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1764ada5-22f6-49b3-bf50-d81e98d60921 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:54.663760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1764ada5-22f6-49b3-bf50-d81e98d60921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:54.671363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:54.819911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e9676-e1e6-4f90-a3e6-69e31c979923 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:54.834445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e9676-e1e6-4f90-a3e6-69e31c979923 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:54.839650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96b1ab-489d-442b-a182-e48d2972cbf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:54.840270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96b1ab-489d-442b-a182-e48d2972cbf3 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:54.840542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96b1ab-489d-442b-a182-e48d2972cbf3 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:54.840806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96b1ab-489d-442b-a182-e48d2972cbf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:54.848513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96b1ab-489d-442b-a182-e48d2972cbf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:54.850107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96b1ab-489d-442b-a182-e48d2972cbf3 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:54.859412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 710/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:55.739019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9455-4d4b-4368-8274-5fa699fba6bb None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:55.739019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9455-4d4b-4368-8274-5fa699fba6bb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:55.739019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9455-4d4b-4368-8274-5fa699fba6bb None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:55.740207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:55.745284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd3f1-2010-42e3-a032-11a111c2874a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:55.745713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd3f1-2010-42e3-a032-11a111c2874a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:55.745847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dd3f1-2010-42e3-a032-11a111c2874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:55.763759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e95dd3f1-2010-42e3-a032-11a111c2874a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:55.764919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e95dd3f1-2010-42e3-a032-11a111c2874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:55.772478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:55.925915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9455-4d4b-4368-8274-5fa699fba6bb None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:55.939988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9455-4d4b-4368-8274-5fa699fba6bb None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:55.945311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293859b-fbd2-436d-908a-5bf7ad2abeab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:55.945960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293859b-fbd2-436d-908a-5bf7ad2abeab service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:55.946258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293859b-fbd2-436d-908a-5bf7ad2abeab service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:55.946525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293859b-fbd2-436d-908a-5bf7ad2abeab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:55.954913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293859b-fbd2-436d-908a-5bf7ad2abeab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:55.956525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293859b-fbd2-436d-908a-5bf7ad2abeab service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:55.966185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 729/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:49:58.036956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522d57-284b-4f3b-a1f8-56c1885ac4d6 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:58.037476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522d57-284b-4f3b-a1f8-56c1885ac4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:58.037476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522d57-284b-4f3b-a1f8-56c1885ac4d6 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:58.038806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:49:58.044527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f549dc-7188-4a82-bc72-ab3036062b0b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:58.044938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f549dc-7188-4a82-bc72-ab3036062b0b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:58.045072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f549dc-7188-4a82-bc72-ab3036062b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:58.062972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-82f549dc-7188-4a82-bc72-ab3036062b0b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:49:58.064144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-82f549dc-7188-4a82-bc72-ab3036062b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:58.071733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:49:58.109321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522d57-284b-4f3b-a1f8-56c1885ac4d6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:49:58.110986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c0522d57-284b-4f3b-a1f8-56c1885ac4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:49:58.124073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522d57-284b-4f3b-a1f8-56c1885ac4d6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:49:58.127537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8673e-ea9d-4216-b05e-77484520dff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:49:58.128159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8673e-ea9d-4216-b05e-77484520dff6 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:49:58.128433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8673e-ea9d-4216-b05e-77484520dff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:49:58.128700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8673e-ea9d-4216-b05e-77484520dff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:49:58.137189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8673e-ea9d-4216-b05e-77484520dff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:49:58.138651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8673e-ea9d-4216-b05e-77484520dff6 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:49:58.147614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 713/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:00.515664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871ba0-bc6b-4a49-970c-b050a40393c3 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:00.516227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871ba0-bc6b-4a49-970c-b050a40393c3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:00.516227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871ba0-bc6b-4a49-970c-b050a40393c3 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:00.517612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:00.523171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2a86e-fa7e-4805-afae-84470a1641cd None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:00.523683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2a86e-fa7e-4805-afae-84470a1641cd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:00.523683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2a86e-fa7e-4805-afae-84470a1641cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:00.544742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-cfc2a86e-fa7e-4805-afae-84470a1641cd None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:00.545968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cfc2a86e-fa7e-4805-afae-84470a1641cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:00.553672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:00.591265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45871ba0-bc6b-4a49-970c-b050a40393c3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:00.601764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45871ba0-bc6b-4a49-970c-b050a40393c3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:00.605821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fa0bc-88d4-44a7-8f60-4576f17e8290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:00.606748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fa0bc-88d4-44a7-8f60-4576f17e8290 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:00.607095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fa0bc-88d4-44a7-8f60-4576f17e8290 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:00.607440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fa0bc-88d4-44a7-8f60-4576f17e8290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:00.616246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fa0bc-88d4-44a7-8f60-4576f17e8290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:00.617718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fa0bc-88d4-44a7-8f60-4576f17e8290 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:00.628268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 732/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:03.123988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9024dc-c040-4f01-bec7-58311d821793 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:03.124560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9024dc-c040-4f01-bec7-58311d821793 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:03.124560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9024dc-c040-4f01-bec7-58311d821793 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:03.125894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:03.131242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d03866-5bd1-4d46-899a-f8f0949f2358 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:03.131653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d03866-5bd1-4d46-899a-f8f0949f2358 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:03.131783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d03866-5bd1-4d46-899a-f8f0949f2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:03.149548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c3d03866-5bd1-4d46-899a-f8f0949f2358 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:03.150759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c3d03866-5bd1-4d46-899a-f8f0949f2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:03.158637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:03.196041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9024dc-c040-4f01-bec7-58311d821793 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:03.207054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9024dc-c040-4f01-bec7-58311d821793 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:03.210554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689bcb4-0bc0-4973-8127-6aad3bbc5c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:03.211177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689bcb4-0bc0-4973-8127-6aad3bbc5c15 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:03.211457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689bcb4-0bc0-4973-8127-6aad3bbc5c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:03.211730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689bcb4-0bc0-4973-8127-6aad3bbc5c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:03.220348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689bcb4-0bc0-4973-8127-6aad3bbc5c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:03.221809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689bcb4-0bc0-4973-8127-6aad3bbc5c15 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:03.230898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 716/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:05.578114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e357e-e94d-47ec-8c2d-c4c536767c50 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:05.578747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e357e-e94d-47ec-8c2d-c4c536767c50 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:05.578747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e357e-e94d-47ec-8c2d-c4c536767c50 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:05.580026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:05.585217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1dd0f-9832-4a6e-a641-e92238c3b80b None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:05.585802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1dd0f-9832-4a6e-a641-e92238c3b80b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:05.586079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1dd0f-9832-4a6e-a641-e92238c3b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:05.603170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7fe1dd0f-9832-4a6e-a641-e92238c3b80b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:05.604870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7fe1dd0f-9832-4a6e-a641-e92238c3b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:05.612774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:05.650277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e357e-e94d-47ec-8c2d-c4c536767c50 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:05.660859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e357e-e94d-47ec-8c2d-c4c536767c50 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:05.664421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80accc8-8e9a-4e8c-beed-180af73a7162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:05.664989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80accc8-8e9a-4e8c-beed-180af73a7162 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:05.665267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80accc8-8e9a-4e8c-beed-180af73a7162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:05.665540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80accc8-8e9a-4e8c-beed-180af73a7162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:05.674701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80accc8-8e9a-4e8c-beed-180af73a7162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:05.676138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80accc8-8e9a-4e8c-beed-180af73a7162 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:05.686006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 735/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:08.005425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a79694-97d0-4aaf-a64e-e49263271881 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:08.005999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a79694-97d0-4aaf-a64e-e49263271881 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:08.005999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a79694-97d0-4aaf-a64e-e49263271881 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:08.007308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:08.013142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6ced-1834-48ae-8b37-86eddf63309f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:08.013625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6ced-1834-48ae-8b37-86eddf63309f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:08.013769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d6ced-1834-48ae-8b37-86eddf63309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:08.031345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c16d6ced-1834-48ae-8b37-86eddf63309f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:08.032503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c16d6ced-1834-48ae-8b37-86eddf63309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:08.040120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:08.077274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a79694-97d0-4aaf-a64e-e49263271881 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:08.087467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a79694-97d0-4aaf-a64e-e49263271881 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:08.091438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec3de-b780-42ce-bb9e-c1a6a307b95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:08.092060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec3de-b780-42ce-bb9e-c1a6a307b95e service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:08.092336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec3de-b780-42ce-bb9e-c1a6a307b95e service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:08.092602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec3de-b780-42ce-bb9e-c1a6a307b95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:08.101056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ec3de-b780-42ce-bb9e-c1a6a307b95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:08.102504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ec3de-b780-42ce-bb9e-c1a6a307b95e service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:08.112073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 719/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:10.433999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e983a-e28e-4b32-8070-86860692245c None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:10.434474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e983a-e28e-4b32-8070-86860692245c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:10.434582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e983a-e28e-4b32-8070-86860692245c None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:10.435897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:10.441190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3255a26-b931-475f-8896-60fa1e5dc12c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:10.441643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3255a26-b931-475f-8896-60fa1e5dc12c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:10.441790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3255a26-b931-475f-8896-60fa1e5dc12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:10.458876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a3255a26-b931-475f-8896-60fa1e5dc12c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:10.460054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a3255a26-b931-475f-8896-60fa1e5dc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:10.468212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:10.505679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e983a-e28e-4b32-8070-86860692245c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:10.520343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e983a-e28e-4b32-8070-86860692245c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:10.523847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4211e5-60b5-443d-a250-1ad93d92ca1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:10.524473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4211e5-60b5-443d-a250-1ad93d92ca1c service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:10.524748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4211e5-60b5-443d-a250-1ad93d92ca1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:10.525018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4211e5-60b5-443d-a250-1ad93d92ca1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:10.534299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4211e5-60b5-443d-a250-1ad93d92ca1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:10.535723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4211e5-60b5-443d-a250-1ad93d92ca1c service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:10.545135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 738/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:12.816068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9936e2-7798-4cc7-9ce0-bbb050bac14a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:12.816603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9936e2-7798-4cc7-9ce0-bbb050bac14a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:12.816603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9936e2-7798-4cc7-9ce0-bbb050bac14a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:12.817873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:12.823201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3259-0203-4dc9-9dc0-4ad8044890f2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:12.823682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3259-0203-4dc9-9dc0-4ad8044890f2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:12.823792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd3259-0203-4dc9-9dc0-4ad8044890f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:12.841937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a3dd3259-0203-4dc9-9dc0-4ad8044890f2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:12.843107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a3dd3259-0203-4dc9-9dc0-4ad8044890f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:12.850844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:12.887659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9936e2-7798-4cc7-9ce0-bbb050bac14a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:12.897822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9936e2-7798-4cc7-9ce0-bbb050bac14a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:12.901752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fcb3-c49a-439b-9597-7bff636337a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:12.902376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fcb3-c49a-439b-9597-7bff636337a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:12.902644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fcb3-c49a-439b-9597-7bff636337a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:12.902908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fcb3-c49a-439b-9597-7bff636337a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:12.911279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fcb3-c49a-439b-9597-7bff636337a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:12.912697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fcb3-c49a-439b-9597-7bff636337a7 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:12.922160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 722/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:15.160351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4b2eb-04fa-446a-ba6d-317685529de5 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:15.160930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4b2eb-04fa-446a-ba6d-317685529de5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:15.160930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4b2eb-04fa-446a-ba6d-317685529de5 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:15.162351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:15.167677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd65a7-57c2-4125-a974-a204636c5fd3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:15.168093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd65a7-57c2-4125-a974-a204636c5fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:15.168215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd65a7-57c2-4125-a974-a204636c5fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:15.185516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a9fd65a7-57c2-4125-a974-a204636c5fd3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:15.186718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a9fd65a7-57c2-4125-a974-a204636c5fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:15.194195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:15.230687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4b2eb-04fa-446a-ba6d-317685529de5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:15.242382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4b2eb-04fa-446a-ba6d-317685529de5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:15.246413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d703f8-6a4b-4ad8-9911-a0198f3e944d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:15.247076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d703f8-6a4b-4ad8-9911-a0198f3e944d service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:15.247352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d703f8-6a4b-4ad8-9911-a0198f3e944d service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:15.247616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d703f8-6a4b-4ad8-9911-a0198f3e944d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:15.256372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d703f8-6a4b-4ad8-9911-a0198f3e944d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:15.257820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d703f8-6a4b-4ad8-9911-a0198f3e944d service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:15.267508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 741/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:17.496469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d08c-470f-40e4-9ef4-1a697b7c88e4 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:17.497042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d08c-470f-40e4-9ef4-1a697b7c88e4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:17.497042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d08c-470f-40e4-9ef4-1a697b7c88e4 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:17.498407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:17.503547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4dc90-c843-49c0-8b50-fbfc663370e2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:17.503968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4dc90-c843-49c0-8b50-fbfc663370e2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:17.504068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4dc90-c843-49c0-8b50-fbfc663370e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:17.521378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-bec4dc90-c843-49c0-8b50-fbfc663370e2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:17.522554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bec4dc90-c843-49c0-8b50-fbfc663370e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:17.530757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:17.566013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d08c-470f-40e4-9ef4-1a697b7c88e4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:17.576935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d08c-470f-40e4-9ef4-1a697b7c88e4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:17.580611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d8a42-a29c-47f0-8147-f34831673f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:17.581234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8a42-a29c-47f0-8147-f34831673f56 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:17.581504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8a42-a29c-47f0-8147-f34831673f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:17.581784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d8a42-a29c-47f0-8147-f34831673f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:17.590940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d8a42-a29c-47f0-8147-f34831673f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:17.592360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d8a42-a29c-47f0-8147-f34831673f56 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:17.601270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 725/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:19.812791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ed20d-9c0d-4728-b402-3e67f1017881 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:19.813319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ed20d-9c0d-4728-b402-3e67f1017881 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:19.813413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ed20d-9c0d-4728-b402-3e67f1017881 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:19.814770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:19.820018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a92b-b3e4-4ce4-bfd4-eb86a32a12d4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:19.820451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a92b-b3e4-4ce4-bfd4-eb86a32a12d4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:19.820624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a92b-b3e4-4ce4-bfd4-eb86a32a12d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:19.839693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5c58a92b-b3e4-4ce4-bfd4-eb86a32a12d4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:19.841296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5c58a92b-b3e4-4ce4-bfd4-eb86a32a12d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:19.848928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:19.884380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ed20d-9c0d-4728-b402-3e67f1017881 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:19.895192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ed20d-9c0d-4728-b402-3e67f1017881 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:19.898612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92689520-00bd-40f1-9bc5-18cdc0a993b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:19.899232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92689520-00bd-40f1-9bc5-18cdc0a993b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:19.899503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92689520-00bd-40f1-9bc5-18cdc0a993b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:19.899768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92689520-00bd-40f1-9bc5-18cdc0a993b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:19.908727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92689520-00bd-40f1-9bc5-18cdc0a993b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:19.910182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92689520-00bd-40f1-9bc5-18cdc0a993b2 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:19.919063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 744/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:50:53.068946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a71bd-7a19-42ce-b41a-2a317385aa20 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:53.069572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a71bd-7a19-42ce-b41a-2a317385aa20 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:53.069572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a71bd-7a19-42ce-b41a-2a317385aa20 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:53.070863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 727/1471] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:53.076083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d48469-dad0-431e-9572-f17ef4241a34 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:53.076529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d48469-dad0-431e-9572-f17ef4241a34 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:53.076642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d48469-dad0-431e-9572-f17ef4241a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:53.093774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-22d48469-dad0-431e-9572-f17ef4241a34 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:53.094939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-22d48469-dad0-431e-9572-f17ef4241a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:53.106192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 745/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:53.151712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82e9f-1b22-4275-8980-d53caa16688c None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:53.151990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82e9f-1b22-4275-8980-d53caa16688c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:53.152259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82e9f-1b22-4275-8980-d53caa16688c None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:53.153589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 728/1473] 10.222.0.70 () {54 vars in 962 bytes} [Mon May 16 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:53.158146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7e51-f9aa-4805-bfb1-21e81fb435e6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:53.158429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7e51-f9aa-4805-bfb1-21e81fb435e6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:53.158708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7e51-f9aa-4805-bfb1-21e81fb435e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:53.176673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-03dd7e51-f9aa-4805-bfb1-21e81fb435e6 None None] MFA Rules not processed for user `9e3e792f55154143932d62ac460022b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:53.177864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-03dd7e51-f9aa-4805-bfb1-21e81fb435e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:53.184227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 746/1474] 10.222.0.70 () {58 vars in 1059 bytes} [Mon May 16 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:53.191172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f82e9f-1b22-4275-8980-d53caa16688c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:53.201236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f82e9f-1b22-4275-8980-d53caa16688c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:53.204613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521cca3-4720-4f73-96de-86b0469c0e02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:53.205222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521cca3-4720-4f73-96de-86b0469c0e02 service glance] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:53.205491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521cca3-4720-4f73-96de-86b0469c0e02 service glance] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:53.205777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521cca3-4720-4f73-96de-86b0469c0e02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:53.214785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521cca3-4720-4f73-96de-86b0469c0e02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:53.216239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521cca3-4720-4f73-96de-86b0469c0e02 service glance] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:53.225321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 729/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:50:55.528207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047067-09a6-41fe-970c-220132addd7b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:55.528789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047067-09a6-41fe-970c-220132addd7b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:55.528789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047067-09a6-41fe-970c-220132addd7b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:55.530183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 747/1476] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:55.535306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6e5d-2c8f-466f-9473-5907a8e0c5ed None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:55.535751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6e5d-2c8f-466f-9473-5907a8e0c5ed None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:55.535859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6e5d-2c8f-466f-9473-5907a8e0c5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:55.553491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0baa6e5d-2c8f-466f-9473-5907a8e0c5ed None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:55.554712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0baa6e5d-2c8f-466f-9473-5907a8e0c5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:55.562406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 730/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:55.584739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf047067-09a6-41fe-970c-220132addd7b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:55.597558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf047067-09a6-41fe-970c-220132addd7b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:55.602023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:55.602655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:55.602931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:55.603777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:55.604500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:55.606526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:50:55.606526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:50:55.606526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:50:55.607693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7fac6-7e16-421d-b6f3-e38f6fc97824 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:55.625942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 748/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Mon May 16 16:50:55 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:50:57.869459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455745-68fd-40e0-8386-d11c25eb1ce5 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:57.870021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455745-68fd-40e0-8386-d11c25eb1ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:57.870021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455745-68fd-40e0-8386-d11c25eb1ce5 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:57.871396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 731/1479] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:50:57.876573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe114-b5f6-4a4f-806d-a8925c6e2d28 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:57.876982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe114-b5f6-4a4f-806d-a8925c6e2d28 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:57.877126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe114-b5f6-4a4f-806d-a8925c6e2d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:57.894556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f3ebe114-b5f6-4a4f-806d-a8925c6e2d28 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:50:57.895735 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f3ebe114-b5f6-4a4f-806d-a8925c6e2d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:50:57.903904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 749/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:50:57.946178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87455745-68fd-40e0-8386-d11c25eb1ce5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:50:57.960590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87455745-68fd-40e0-8386-d11c25eb1ce5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:50:57.965944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2403776-8412-4f95-a2c1-e016f47a4fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:50:57.966569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403776-8412-4f95-a2c1-e016f47a4fe3 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:50:57.966842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403776-8412-4f95-a2c1-e016f47a4fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:50:57.967108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2403776-8412-4f95-a2c1-e016f47a4fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:50:57.975080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2403776-8412-4f95-a2c1-e016f47a4fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:50:57.976639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2403776-8412-4f95-a2c1-e016f47a4fe3 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:50:57.985970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 732/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:51:00.346340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44744031-2eb6-4d98-a994-837b6835f714 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:00.346901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44744031-2eb6-4d98-a994-837b6835f714 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:00.346901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44744031-2eb6-4d98-a994-837b6835f714 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:00.348217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 750/1482] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:51:00.353897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65729-22c3-456d-bfe7-e64cc0d366fe None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:00.354365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65729-22c3-456d-bfe7-e64cc0d366fe None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:00.354473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65729-22c3-456d-bfe7-e64cc0d366fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:00.372085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7eb65729-22c3-456d-bfe7-e64cc0d366fe None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:51:00.373255 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7eb65729-22c3-456d-bfe7-e64cc0d366fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:51:00.380884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 733/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:51:00.416544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44744031-2eb6-4d98-a994-837b6835f714 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:51:00.426945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44744031-2eb6-4d98-a994-837b6835f714 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:51:00.430334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776beaa9-ef8d-4d3d-8eb7-7159621cc533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:51:00.430958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776beaa9-ef8d-4d3d-8eb7-7159621cc533 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:00.431870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776beaa9-ef8d-4d3d-8eb7-7159621cc533 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:00.432139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776beaa9-ef8d-4d3d-8eb7-7159621cc533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:00.440707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776beaa9-ef8d-4d3d-8eb7-7159621cc533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:51:00.442169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776beaa9-ef8d-4d3d-8eb7-7159621cc533 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:51:00.451290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 751/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:51:02.739715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489c7e7-b579-4804-87fa-e7a4697cb0c1 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:02.740254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489c7e7-b579-4804-87fa-e7a4697cb0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:02.740254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489c7e7-b579-4804-87fa-e7a4697cb0c1 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:02.741641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 734/1485] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:51:02.746803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d77d6-bc81-4411-85e5-611871e63c3a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:02.747222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d77d6-bc81-4411-85e5-611871e63c3a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:02.747353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d77d6-bc81-4411-85e5-611871e63c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:02.765132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-680d77d6-bc81-4411-85e5-611871e63c3a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:51:02.766390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-680d77d6-bc81-4411-85e5-611871e63c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:51:02.773990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 752/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:51:02.810785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489c7e7-b579-4804-87fa-e7a4697cb0c1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:51:02.820992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489c7e7-b579-4804-87fa-e7a4697cb0c1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:51:02.824904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b184a5d-40d7-4281-afd6-91194404b917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:51:02.825521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184a5d-40d7-4281-afd6-91194404b917 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:02.825823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184a5d-40d7-4281-afd6-91194404b917 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:02.826091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b184a5d-40d7-4281-afd6-91194404b917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:02.834506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184a5d-40d7-4281-afd6-91194404b917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:51:02.835914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b184a5d-40d7-4281-afd6-91194404b917 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:51:02.845366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 735/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:51:05.230420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd22a-641d-4995-8aa6-675f4d5a339b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:05.231257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd22a-641d-4995-8aa6-675f4d5a339b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:05.231257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffd22a-641d-4995-8aa6-675f4d5a339b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:05.232586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 753/1488] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:51:05.238032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb97e2-4a36-4b81-9e33-fe5ea3a91cd9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:05.238443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb97e2-4a36-4b81-9e33-fe5ea3a91cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:05.238574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb97e2-4a36-4b81-9e33-fe5ea3a91cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:05.255325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-76fb97e2-4a36-4b81-9e33-fe5ea3a91cd9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:51:05.256509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-76fb97e2-4a36-4b81-9e33-fe5ea3a91cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:51:05.264050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 736/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:51:05.303986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffd22a-641d-4995-8aa6-675f4d5a339b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:51:05.314361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffd22a-641d-4995-8aa6-675f4d5a339b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:51:05.317850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ca733-bda5-4231-ac20-ff284d4a99bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:51:05.318467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ca733-bda5-4231-ac20-ff284d4a99bb service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:05.318741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ca733-bda5-4231-ac20-ff284d4a99bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:05.319008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ca733-bda5-4231-ac20-ff284d4a99bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:05.327484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ca733-bda5-4231-ac20-ff284d4a99bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:51:05.328935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ca733-bda5-4231-ac20-ff284d4a99bb service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:51:05.338873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 754/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:51:07.705896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002e98-ef88-4a37-baa4-439b942b9ff3 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:07.706484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002e98-ef88-4a37-baa4-439b942b9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:07.706484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0002e98-ef88-4a37-baa4-439b942b9ff3 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:07.707698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 737/1491] 10.222.0.70 () {54 vars in 926 bytes} [Mon May 16 16:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:51:07.712990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414927e-47e3-4c23-b99b-40d64d1d9bcc None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:07.713470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414927e-47e3-4c23-b99b-40d64d1d9bcc None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:07.713583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414927e-47e3-4c23-b99b-40d64d1d9bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:07.730551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e414927e-47e3-4c23-b99b-40d64d1d9bcc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:51:07.731968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e414927e-47e3-4c23-b99b-40d64d1d9bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:51:07.739677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 755/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Mon May 16 16:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:51:07.777657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002e98-ef88-4a37-baa4-439b942b9ff3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:51:07.788339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0002e98-ef88-4a37-baa4-439b942b9ff3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:51:07.792380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ead70-b13b-4444-abe3-3db3acb8f4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:51:07.793004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ead70-b13b-4444-abe3-3db3acb8f4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:51:07.793275 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ead70-b13b-4444-abe3-3db3acb8f4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:51:07.793541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ead70-b13b-4444-abe3-3db3acb8f4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:51:07.802010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ead70-b13b-4444-abe3-3db3acb8f4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:51:07.803425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ead70-b13b-4444-abe3-3db3acb8f4e2 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:51:07.812898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 738/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:52:48.718034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:48.718592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:48.718592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:48.735978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:52:48.737146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:48.745305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 756/1494] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:52:48.754405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:48.754909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:48.755016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:48.772477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:52:48.773629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:48.781216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 739/1495] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:52:48.785697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:48.795085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9290e87-4b6f-47cd-9438-957db7d2d83d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:48.799575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:48.800213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:48.800493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:48.800765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:48.801484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:52:48.801822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:48.802832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:48.802832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:52:48.802832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:52:48.803726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:48.815251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 757/1496] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:52:48.823608 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:48.832221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6f91f-a20b-4621-a082-b9762a91654a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:48.836644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:48.837291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:48.837563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:48.837864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:48.838541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:48.840234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:48.840234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:52:48.840234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:52:48.841410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:48.877551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 740/1497] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:52:48 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:52:48.881880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:48.892466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7c2b9-807c-4dac-b61b-d78062db75e5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:48.951223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:48.951884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:48.952165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:48.952437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:48.953129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:48.954181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:48.954181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:52:48.954181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:52:48.955410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:48.974353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 758/1498] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:52:48 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:52:48.978840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:48.988947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d914cb-de0b-4c2b-adc6-635e4dd61e26 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:48.994237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:48.994893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:48.995171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:48.995446 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:48.996170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:48.997204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:48.997204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:52:48.997204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:52:48.998132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:49.011028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 741/1499] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:52:49.014918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:49.024454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531b40-156c-464d-9b6a-dc6770b63165 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:49.028909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:49.029552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.029864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.030137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.030858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:49.031861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:49.031861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:52:49.031861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:52:49.032748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441752d-d2e5-4f44-8fb0-0a01c31f120c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:49.045892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 759/1500] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:52:49.049770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:49.059737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81360a-2097-4711-baca-7c95c86b4834 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:49.064167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:49.065015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.065286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.065556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] PATH_INFO: `/v3/projects/ba3fb64b1e6c4644a823cd6cd7059a91/users/d565eced31304461980e71fbb68ae126/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.078981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3fb64b1e6c4644a823cd6cd7059a91, user_id=d565eced31304461980e71fbb68ae126, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:49.079987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:49.079987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:52:49.079987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:52:49.081942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43820cd-f1ee-49d2-b1fb-ee29e215ca44 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:49.094405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 742/1501] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:52:49 2022] PUT /identity/v3/projects/ba3fb64b1e6c4644a823cd6cd7059a91/users/d565eced31304461980e71fbb68ae126/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:52:49.106228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63db2f-25d7-4ba4-acff-c5941b56a266 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.106516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63db2f-25d7-4ba4-acff-c5941b56a266 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.106792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63db2f-25d7-4ba4-acff-c5941b56a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.133067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ff63db2f-25d7-4ba4-acff-c5941b56a266 None None] MFA Rules not processed for user `d565eced31304461980e71fbb68ae126`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:52:49.134318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ff63db2f-25d7-4ba4-acff-c5941b56a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:49.202089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 760/1502] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:52:49.215479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10475c6-cb25-49b6-b397-5b68349d015f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.215764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10475c6-cb25-49b6-b397-5b68349d015f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.216031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10475c6-cb25-49b6-b397-5b68349d015f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.217383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 743/1503] 10.222.0.70 () {54 vars in 963 bytes} [Mon May 16 16:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:52:49.222271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099cf31-41e4-43f8-9179-c44563222511 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.222560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099cf31-41e4-43f8-9179-c44563222511 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.222838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099cf31-41e4-43f8-9179-c44563222511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.241210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5099cf31-41e4-43f8-9179-c44563222511 None None] MFA Rules not processed for user `c3d39e375e994373b5bd403baa053e45`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:52:49.242995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5099cf31-41e4-43f8-9179-c44563222511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:49.290021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 761/1504] 10.222.0.70 () {58 vars in 1060 bytes} [Mon May 16 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:52:49.297158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10475c6-cb25-49b6-b397-5b68349d015f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:49.307854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10475c6-cb25-49b6-b397-5b68349d015f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:49.311282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:49.311888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.312158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.312422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.320262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:49.321703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:49.330007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 744/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:52:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:52:49.374372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b83df-b0c6-4ba9-ba1d-e63c7e8d6352 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.374654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b83df-b0c6-4ba9-ba1d-e63c7e8d6352 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.374924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b83df-b0c6-4ba9-ba1d-e63c7e8d6352 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.376184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 762/1506] 10.222.0.70 () {52 vars in 829 bytes} [Mon May 16 16:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:52:49.379699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:49.438725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c82709-25f2-4bb6-afea-4bcb129257dd service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:49.443179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:49.444025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.444298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.444581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] PATH_INFO: `/v3/users/d565eced31304461980e71fbb68ae126` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.445715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d565eced31304461980e71fbb68ae126)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:49.446735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:49.446735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:52:49.446735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:52:49.447929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:49.512188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd565eced31304461980e71fbb68ae126'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:49.525749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd565eced31304461980e71fbb68ae126'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:49.534628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd565eced31304461980e71fbb68ae126'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:49.535252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd565eced31304461980e71fbb68ae126'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:49.553321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd565eced31304461980e71fbb68ae126'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:49.559485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 745/1507] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:52:49 2022] DELETE /identity/v3/users/d565eced31304461980e71fbb68ae126 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:52:49.563888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.564272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.564608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.581613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:52:49.582850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:49.638132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 763/1508] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:52:49.647541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:49.649473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:49.703441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52adad-e7ee-4139-8f31-695dde89fd59 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:49.707035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1df936-5ade-4a72-af4e-e17b68916480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:49.707673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df936-5ade-4a72-af4e-e17b68916480 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:49.707951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df936-5ade-4a72-af4e-e17b68916480 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:49.708223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1df936-5ade-4a72-af4e-e17b68916480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:49.717402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1df936-5ade-4a72-af4e-e17b68916480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:49.718871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1df936-5ade-4a72-af4e-e17b68916480 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:49.728749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 746/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:52:50.053895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:52:50.055375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:52:50.067459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719b07-e16a-42eb-a021-77415d5cf2cc None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:52:50.075327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:52:50.076475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:52:50.077013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:52:50.077772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] PATH_INFO: `/v3/projects/ba3fb64b1e6c4644a823cd6cd7059a91` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:52:50.080432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3fb64b1e6c4644a823cd6cd7059a91)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:52:50.082062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:52:50.082062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:52:50.082062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:52:50.084216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:52:50.154122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3fb64b1e6c4644a823cd6cd7059a91', 'request_id': 'req-0773e715-78e0-44d3-9091-65cfbad394ff'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:50.164291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3fb64b1e6c4644a823cd6cd7059a91', 'request_id': 'req-0773e715-78e0-44d3-9091-65cfbad394ff'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:50.170312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3fb64b1e6c4644a823cd6cd7059a91', 'request_id': 'req-0773e715-78e0-44d3-9091-65cfbad394ff'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:50.193455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] The token cache is being invalidate because project ba3fb64b1e6c4644a823cd6cd7059a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:52:50.193963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:50.195474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0773e715-78e0-44d3-9091-65cfbad394ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:52:50.197070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 764/1510] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:52:50 2022] DELETE /identity/v3/projects/ba3fb64b1e6c4644a823cd6cd7059a91 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:54:30.809464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ffc1-aabe-45c7-ae4a-67e60b4c536f None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:30.810056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ffc1-aabe-45c7-ae4a-67e60b4c536f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:30.810056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318ffc1-aabe-45c7-ae4a-67e60b4c536f None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:30.811384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:30.816376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34753-6d6e-4095-86dd-e288cdec18a2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:30.816889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34753-6d6e-4095-86dd-e288cdec18a2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:30.816982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34753-6d6e-4095-86dd-e288cdec18a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:30.834890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9ed34753-6d6e-4095-86dd-e288cdec18a2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:30.836077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9ed34753-6d6e-4095-86dd-e288cdec18a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:30.891554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:31.058645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ffc1-aabe-45c7-ae4a-67e60b4c536f None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:31.060346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7318ffc1-aabe-45c7-ae4a-67e60b4c536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:31.130978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318ffc1-aabe-45c7-ae4a-67e60b4c536f None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:31.136335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0961c0-2e38-4eed-89c0-6a8706635122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:31.136969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0961c0-2e38-4eed-89c0-6a8706635122 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:31.137246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0961c0-2e38-4eed-89c0-6a8706635122 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:31.137518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0961c0-2e38-4eed-89c0-6a8706635122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:31.145304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0961c0-2e38-4eed-89c0-6a8706635122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:31.147420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0961c0-2e38-4eed-89c0-6a8706635122 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:31.156553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 748/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:31.744972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886940-fe76-4377-8690-8d5050b69fb1 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:31.745181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886940-fe76-4377-8690-8d5050b69fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:31.745442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb886940-fe76-4377-8690-8d5050b69fb1 None None] PATH_INFO: `/v3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:31.746814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 766/1514] 10.222.0.57 () {54 vars in 925 bytes} [Mon May 16 16:54:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:54:31.753166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4469028-b786-4c46-bee4-cbf540f0dfb8 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:31.753473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4469028-b786-4c46-bee4-cbf540f0dfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:31.753765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4469028-b786-4c46-bee4-cbf540f0dfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:31.772024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c4469028-b786-4c46-bee4-cbf540f0dfb8 None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:31.773194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c4469028-b786-4c46-bee4-cbf540f0dfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:31.832309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 749/1515] 10.222.0.57 () {58 vars in 1015 bytes} [Mon May 16 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:32.053072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ddf29-88ee-44d4-b9e5-946f6d73238b None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:32.053604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ddf29-88ee-44d4-b9e5-946f6d73238b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:32.053604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ddf29-88ee-44d4-b9e5-946f6d73238b None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:32.054946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 767/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:32.059670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d49e-ab64-4e1d-a843-bdf8f57b891a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:32.059953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d49e-ab64-4e1d-a843-bdf8f57b891a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:32.060222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d49e-ab64-4e1d-a843-bdf8f57b891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:32.078123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b613d49e-ab64-4e1d-a843-bdf8f57b891a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:32.079283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b613d49e-ab64-4e1d-a843-bdf8f57b891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:32.086885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 750/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:32.238071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ddf29-88ee-44d4-b9e5-946f6d73238b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:32.252817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ddf29-88ee-44d4-b9e5-946f6d73238b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:32.258180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b065f83-47a7-4e4b-a327-ad0362ee8466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:32.258816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065f83-47a7-4e4b-a327-ad0362ee8466 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:32.259092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065f83-47a7-4e4b-a327-ad0362ee8466 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:32.259364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b065f83-47a7-4e4b-a327-ad0362ee8466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:32.267203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b065f83-47a7-4e4b-a327-ad0362ee8466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:32.268805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b065f83-47a7-4e4b-a327-ad0362ee8466 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:32.278055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 768/1518] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:40.768647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416bd8d-7a17-4100-9d94-697408dfb79a None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:40.769268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416bd8d-7a17-4100-9d94-697408dfb79a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:40.769268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416bd8d-7a17-4100-9d94-697408dfb79a None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:40.771106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 751/1519] 10.222.0.70 () {54 vars in 960 bytes} [Mon May 16 16:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:40.775908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a83b0-6fe6-4fbc-985c-9d691483be7f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:40.776374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a83b0-6fe6-4fbc-985c-9d691483be7f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:40.776488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a83b0-6fe6-4fbc-985c-9d691483be7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:40.793945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a80a83b0-6fe6-4fbc-985c-9d691483be7f None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:40.795153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a80a83b0-6fe6-4fbc-985c-9d691483be7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:40.804059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 769/1520] 10.222.0.70 () {58 vars in 1057 bytes} [Mon May 16 16:54:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:40.812553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416bd8d-7a17-4100-9d94-697408dfb79a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:40.827296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416bd8d-7a17-4100-9d94-697408dfb79a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:40.832194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023e2ba-afc4-4d6c-b164-c66521e2a83d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:40.832834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023e2ba-afc4-4d6c-b164-c66521e2a83d service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:40.833112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023e2ba-afc4-4d6c-b164-c66521e2a83d service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:40.833382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023e2ba-afc4-4d6c-b164-c66521e2a83d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:40.841760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023e2ba-afc4-4d6c-b164-c66521e2a83d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:40.843377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023e2ba-afc4-4d6c-b164-c66521e2a83d service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:40.852941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 752/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:43.574498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210c05-5e94-4e47-a479-e5c53351bbab None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:43.575096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210c05-5e94-4e47-a479-e5c53351bbab None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:43.575096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34210c05-5e94-4e47-a479-e5c53351bbab None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:43.576386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:43.581239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991bcb-08cc-462b-9acb-8db5edbbd8e6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:43.581700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991bcb-08cc-462b-9acb-8db5edbbd8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:43.581837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44991bcb-08cc-462b-9acb-8db5edbbd8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:43.600109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-44991bcb-08cc-462b-9acb-8db5edbbd8e6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:43.601271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-44991bcb-08cc-462b-9acb-8db5edbbd8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:43.609061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:43.763679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210c05-5e94-4e47-a479-e5c53351bbab None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:43.778142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34210c05-5e94-4e47-a479-e5c53351bbab None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:43.783503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5801-e4f5-472e-b387-24a532596359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:43.784129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5801-e4f5-472e-b387-24a532596359 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:43.784407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5801-e4f5-472e-b387-24a532596359 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:43.784678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5801-e4f5-472e-b387-24a532596359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:43.792522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5801-e4f5-472e-b387-24a532596359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:43.794144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5801-e4f5-472e-b387-24a532596359 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:43.803257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 771/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:44.691118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f53bd-0316-4e19-8015-c2cffbca5edb None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:44.691699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f53bd-0316-4e19-8015-c2cffbca5edb None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:44.691699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f53bd-0316-4e19-8015-c2cffbca5edb None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:44.693470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 16 16:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:44.698347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bff1bf-de0a-4a15-bb8a-5995710c1566 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:44.698738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bff1bf-de0a-4a15-bb8a-5995710c1566 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:44.698901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bff1bf-de0a-4a15-bb8a-5995710c1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:44.718329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-57bff1bf-de0a-4a15-bb8a-5995710c1566 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:44.719528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-57bff1bf-de0a-4a15-bb8a-5995710c1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:44.727467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 16 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:44.880352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f53bd-0316-4e19-8015-c2cffbca5edb None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:44.894294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f53bd-0316-4e19-8015-c2cffbca5edb None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:44.900187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ca73-b09a-4314-a269-3a08758de857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:44.900806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ca73-b09a-4314-a269-3a08758de857 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:44.901079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ca73-b09a-4314-a269-3a08758de857 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:44.901345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ca73-b09a-4314-a269-3a08758de857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:44.909060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ca73-b09a-4314-a269-3a08758de857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:44.910704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ca73-b09a-4314-a269-3a08758de857 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:44.920849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 755/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:49.074853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5202ab-63fd-4d20-8991-bc846844d8b9 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:49.075437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5202ab-63fd-4d20-8991-bc846844d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:49.075437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5202ab-63fd-4d20-8991-bc846844d8b9 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:49.076745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:49.081862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c729-f903-485f-bf74-63cccb3865b5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:49.082335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c729-f903-485f-bf74-63cccb3865b5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:49.082441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606c729-f903-485f-bf74-63cccb3865b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:49.100092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7606c729-f903-485f-bf74-63cccb3865b5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:49.101258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7606c729-f903-485f-bf74-63cccb3865b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:49.109034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:49.144136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5202ab-63fd-4d20-8991-bc846844d8b9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:49.145832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1d5202ab-63fd-4d20-8991-bc846844d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:49.199873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5202ab-63fd-4d20-8991-bc846844d8b9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:49.203387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837a75f-f99b-4fa2-a1f4-f49ad2dc6a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:49.204006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a75f-f99b-4fa2-a1f4-f49ad2dc6a0b service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:49.204284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a75f-f99b-4fa2-a1f4-f49ad2dc6a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:49.204556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837a75f-f99b-4fa2-a1f4-f49ad2dc6a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:49.213222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837a75f-f99b-4fa2-a1f4-f49ad2dc6a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:49.214750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837a75f-f99b-4fa2-a1f4-f49ad2dc6a0b service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:49.224384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 774/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:51.416462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36ba2f-42f3-4724-a85c-ef3ad915c04e None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:51.416913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36ba2f-42f3-4724-a85c-ef3ad915c04e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:51.417023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36ba2f-42f3-4724-a85c-ef3ad915c04e None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:51.418396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:51.423478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256e0a-d62e-40a6-b46f-0635c171ce4a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:51.423933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256e0a-d62e-40a6-b46f-0635c171ce4a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:51.424044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c256e0a-d62e-40a6-b46f-0635c171ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:51.442101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6c256e0a-d62e-40a6-b46f-0635c171ce4a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:51.443281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6c256e0a-d62e-40a6-b46f-0635c171ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:51.451224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:51.486793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36ba2f-42f3-4724-a85c-ef3ad915c04e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:51.488431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7c36ba2f-42f3-4724-a85c-ef3ad915c04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:51.501430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36ba2f-42f3-4724-a85c-ef3ad915c04e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:51.504948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb900a5-32e4-40de-8cc4-27d48053e5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:51.505568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb900a5-32e4-40de-8cc4-27d48053e5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:51.505881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb900a5-32e4-40de-8cc4-27d48053e5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:51.506149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb900a5-32e4-40de-8cc4-27d48053e5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:51.514678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb900a5-32e4-40de-8cc4-27d48053e5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:51.516094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb900a5-32e4-40de-8cc4-27d48053e5b8 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:51.525028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 758/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:54:55.290151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224545a8-f781-4c9a-a684-4df12eaf0f79 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:55.290705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224545a8-f781-4c9a-a684-4df12eaf0f79 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:55.290705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224545a8-f781-4c9a-a684-4df12eaf0f79 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:55.292080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:55.297452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a547-828f-40c2-a7d4-90d327c7e506 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:55.297933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a547-828f-40c2-a7d4-90d327c7e506 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:55.298043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a547-828f-40c2-a7d4-90d327c7e506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:55.315794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6e39a547-828f-40c2-a7d4-90d327c7e506 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:55.317526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6e39a547-828f-40c2-a7d4-90d327c7e506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:55.325157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:55.600949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224545a8-f781-4c9a-a684-4df12eaf0f79 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:55.602638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-224545a8-f781-4c9a-a684-4df12eaf0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:55.657478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224545a8-f781-4c9a-a684-4df12eaf0f79 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:55.660955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35bb4a-f5ca-47d6-a91d-4a87601df4a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:55.661577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35bb4a-f5ca-47d6-a91d-4a87601df4a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:55.661889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35bb4a-f5ca-47d6-a91d-4a87601df4a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:55.662155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35bb4a-f5ca-47d6-a91d-4a87601df4a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:55.670581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35bb4a-f5ca-47d6-a91d-4a87601df4a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:55.672001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35bb4a-f5ca-47d6-a91d-4a87601df4a6 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:55.680889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 777/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:54:57.945719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640122e-d8ad-4101-9bb1-f8805509baf9 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:57.946242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640122e-d8ad-4101-9bb1-f8805509baf9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:57.946340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640122e-d8ad-4101-9bb1-f8805509baf9 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:57.947662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 16 16:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:54:57.952799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d5728-0433-492f-b5ad-fb1491b04edb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:57.953261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d5728-0433-492f-b5ad-fb1491b04edb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:57.953386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d5728-0433-492f-b5ad-fb1491b04edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:57.971654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-034d5728-0433-492f-b5ad-fb1491b04edb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:54:57.972830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-034d5728-0433-492f-b5ad-fb1491b04edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:57.980864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 16 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:54:58.248496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640122e-d8ad-4101-9bb1-f8805509baf9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:54:58.250202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4640122e-d8ad-4101-9bb1-f8805509baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:54:58.263351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640122e-d8ad-4101-9bb1-f8805509baf9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:54:58.266840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28d018-93af-46af-97d8-585ceb327289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:54:58.267471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d018-93af-46af-97d8-585ceb327289 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:54:58.267745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d018-93af-46af-97d8-585ceb327289 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:54:58.268013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28d018-93af-46af-97d8-585ceb327289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:54:58.276564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28d018-93af-46af-97d8-585ceb327289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:54:58.278014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28d018-93af-46af-97d8-585ceb327289 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:54:58.287138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 761/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:29.864231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8986f1-6522-4aa2-9551-6283c4323386 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:29.865367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8986f1-6522-4aa2-9551-6283c4323386 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:29.865963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8986f1-6522-4aa2-9551-6283c4323386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:29.874711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6f2c-c395-431d-a45f-0c6629af9b93 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:29.875305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6f2c-c395-431d-a45f-0c6629af9b93 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:29.875305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6f2c-c395-431d-a45f-0c6629af9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:29.901524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4b8986f1-6522-4aa2-9551-6283c4323386 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:29.903168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4b8986f1-6522-4aa2-9551-6283c4323386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:29.904235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-838d6f2c-c395-431d-a45f-0c6629af9b93 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:29.905414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-838d6f2c-c395-431d-a45f-0c6629af9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:29.918536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 779/1540] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:29.921775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 762/1541] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:29.930118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a834-e882-4420-9319-73ab31d9301f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:29.930864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a834-e882-4420-9319-73ab31d9301f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:29.931549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a834-e882-4420-9319-73ab31d9301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:29.932518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:29.932808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:29.933086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:29.971187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:29.971447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e958a834-e882-4420-9319-73ab31d9301f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:29.972474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e958a834-e882-4420-9319-73ab31d9301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:29.972801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:29.990042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 763/1542] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:29.995439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:29.995969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 780/1543] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:30.001172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a834-e882-4420-9319-73ab31d9301f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.010559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be446ed-2cbc-45fa-adb1-407c04f42800 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.015741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a834-e882-4420-9319-73ab31d9301f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.021160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.022584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.022866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.023142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.023868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.024171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.025195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 16 16:56:30.025195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:56:30.025195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:56:30.026141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.034514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.035218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.035501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.035778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.036966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.037280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.039521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.050571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 764/1544] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:56:30.059376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.062941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 781/1545] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:56:30.071981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.072218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a74410-bc67-4c99-96c9-699191e88b7b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.086549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.087232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.087512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.087786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.088649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.090634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.092945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0b34c-ccd3-40fb-a59c-9bbd004c26c8 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.113293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.114043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.114503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.114618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.115327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.118648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:56:30.118648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:56:30.118648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:56:30.120397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7f4a6-3ed2-4fb3-8044-f0af662835d9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.131698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 765/1546] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:56:30.136146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.195978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 782/1547] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:30.197346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.197630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.197933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.230493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.231708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.233022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25991956-aae0-41cc-9e26-9b989882db6c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.300173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.300856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.301135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.301409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.302135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.303835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:56:30.303835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:56:30.303835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:56:30.305067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217cc6e-7302-4ecb-ac35-5ff513930b65 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.318348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 783/1548] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.319889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.330034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059f1a-ce19-4c27-8f6e-b87c823e7911 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.341121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca692e-5ad1-4356-bfd1-28b23ece6e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.341822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca692e-5ad1-4356-bfd1-28b23ece6e16 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.342103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca692e-5ad1-4356-bfd1-28b23ece6e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.342373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca692e-5ad1-4356-bfd1-28b23ece6e16 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.343061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca692e-5ad1-4356-bfd1-28b23ece6e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.345031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca692e-5ad1-4356-bfd1-28b23ece6e16 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.348047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 766/1549] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:56:30.349285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967213-34c8-4efc-85ad-87974aa4a8b6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.349573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967213-34c8-4efc-85ad-87974aa4a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.349937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967213-34c8-4efc-85ad-87974aa4a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.369401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 784/1550] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:30.370448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40efe-9ca2-4c1d-b376-2fe1f489dbe5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.370980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40efe-9ca2-4c1d-b376-2fe1f489dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.371311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40efe-9ca2-4c1d-b376-2fe1f489dbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.379306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-cc967213-34c8-4efc-85ad-87974aa4a8b6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.380514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cc967213-34c8-4efc-85ad-87974aa4a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.389237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 767/1551] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.390532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd549-d81b-40eb-9b74-7329d1e41602 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.390815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd549-d81b-40eb-9b74-7329d1e41602 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.391085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddd549-d81b-40eb-9b74-7329d1e41602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.395381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-82c40efe-9ca2-4c1d-b376-2fe1f489dbe5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.396581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-82c40efe-9ca2-4c1d-b376-2fe1f489dbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.410333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 785/1552] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.410333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.410333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.410333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.410788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d4ddd549-d81b-40eb-9b74-7329d1e41602 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.410788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d4ddd549-d81b-40eb-9b74-7329d1e41602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.418671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 768/1553] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.422874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.422874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.422874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.429228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.430455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.438363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 786/1554] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.439073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.439199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.440233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.448770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 769/1555] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.448913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d47b-46bf-4db7-a53c-832eef42fe98 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.449876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.458891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee7a5-ffb2-4d17-a1bc-e59ce6ad6bd6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.459165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5abc8d-250a-44e8-9ea8-f31475bc355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.459871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5abc8d-250a-44e8-9ea8-f31475bc355a admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.460148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5abc8d-250a-44e8-9ea8-f31475bc355a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.460422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5abc8d-250a-44e8-9ea8-f31475bc355a admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.461145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5abc8d-250a-44e8-9ea8-f31475bc355a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.462984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5abc8d-250a-44e8-9ea8-f31475bc355a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.463479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77f669-ef8b-4df5-9745-e95ca9bcd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.464114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77f669-ef8b-4df5-9745-e95ca9bcd509 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.464390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77f669-ef8b-4df5-9745-e95ca9bcd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.464655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77f669-ef8b-4df5-9745-e95ca9bcd509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.465367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77f669-ef8b-4df5-9745-e95ca9bcd509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.467005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77f669-ef8b-4df5-9745-e95ca9bcd509 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.475875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 787/1556] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:30.475875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578fd20-3188-4020-bbba-148ec1c09660 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.475875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578fd20-3188-4020-bbba-148ec1c09660 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.475875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578fd20-3188-4020-bbba-148ec1c09660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.476936 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 770/1557] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:30.478092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ba91-060e-4467-afb1-5832d70beca1 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.478376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ba91-060e-4467-afb1-5832d70beca1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.478636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ba91-060e-4467-afb1-5832d70beca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.494927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2578fd20-3188-4020-bbba-148ec1c09660 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.496111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2578fd20-3188-4020-bbba-148ec1c09660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.496329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c2b6ba91-060e-4467-afb1-5832d70beca1 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.497491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c2b6ba91-060e-4467-afb1-5832d70beca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.504116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 788/1558] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.505138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.505426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.505702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.509944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 771/1559] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.509944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c2a4-59c9-4690-830b-fa41c7d11fdc None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.509944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c2a4-59c9-4690-830b-fa41c7d11fdc None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.509944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c2a4-59c9-4690-830b-fa41c7d11fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.526688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-91c3c2a4-59c9-4690-830b-fa41c7d11fdc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.526860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.527869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-91c3c2a4-59c9-4690-830b-fa41c7d11fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.528009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.535651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 789/1561] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.535798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 772/1561] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.536420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.537130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.537442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.537716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.552266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182d01f-01a9-4c42-9d37-202f0fffa6ed None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.555433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.556606 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.557520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.558205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.558485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.558757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.559472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.559781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.561390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.564447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 773/1562] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.565282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.580393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 790/1563] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:30.580393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.580686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a89986-d31c-4ff9-9846-10a47fbec7ac None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.580686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.580686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.580686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.581044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.581552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.583080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.583545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d250-0328-4ecb-bf5a-5855faf1a859 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.588031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a85779-01b9-4a48-9aea-3c3472b3df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.588664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85779-01b9-4a48-9aea-3c3472b3df52 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.588941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85779-01b9-4a48-9aea-3c3472b3df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.589212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85779-01b9-4a48-9aea-3c3472b3df52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.589953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a85779-01b9-4a48-9aea-3c3472b3df52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.591556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a85779-01b9-4a48-9aea-3c3472b3df52 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.595806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 774/1564] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:30.595806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.603571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d6cbb-a05e-4e3d-8c2d-a10be4d9139d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.605308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 791/1565] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:30.606570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.606874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.607136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.608420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.609058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.609333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.609599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.610345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.610664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.612223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.631431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 775/1566] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:30.631599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:30.631718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.631821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:30.634124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 792/1567] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:30.634972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe81ba-9dad-400d-a681-d09f3e760b78 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.635122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.639627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.640260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.640999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.640999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.641487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.641822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.643407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.644255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d794370-4817-4c2d-8aa7-e387c17d80ec None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.648769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.649394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.649683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.649981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.650684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.650985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.652570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.654987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 776/1568] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:30.655762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.665607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 793/1569] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:30.665607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.669264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7da3-9bfb-460c-916b-a3f64605756c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.675591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.676230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.676503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.676775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.677487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.677814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.679974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.681132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a80336-8256-4b3e-adf5-a7d7831fc819 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.686050 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.686676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.686988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.687257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.687933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.689849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.697868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 777/1570] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:30.697868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.706699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ebf7a-3355-4a94-8e8a-160ca682e684 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.711854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.712708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.712981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.713244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] PATH_INFO: `/v3/projects/08b1d6066aaf4e969b8c69cd72d1de4e/users/58633f982d3840dd88f631bcee882f5f/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.716540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 794/1571] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:30.717408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.730963 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b1d6066aaf4e969b8c69cd72d1de4e, user_id=58633f982d3840dd88f631bcee882f5f, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.733622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.746293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 778/1572] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:30 2022] PUT /identity/v3/projects/08b1d6066aaf4e969b8c69cd72d1de4e/users/58633f982d3840dd88f631bcee882f5f/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:30.747235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.780685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06566a3e-1f3f-42ea-8e6b-9e2df19075a2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.806161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1df81-408e-4f80-bbaf-0006ae12ec6d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.810764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.811405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.811680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.811950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.812650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.814584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.836941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.837867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.838146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.838420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] PATH_INFO: `/v3/projects/a145ae754d55458792b86bdda0ceb304/users/0cfe14bbc5f34432882bf74de0536ab4/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.842292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 779/1573] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:30.843182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.853339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a145ae754d55458792b86bdda0ceb304, user_id=0cfe14bbc5f34432882bf74de0536ab4, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.854415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:56:30.854415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:56:30.854415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:56:30.856370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.870113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 795/1574] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:30 2022] PUT /identity/v3/projects/a145ae754d55458792b86bdda0ceb304/users/0cfe14bbc5f34432882bf74de0536ab4/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:30.872794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.902934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a31c3-ca14-4bfc-b423-a160e7dbcbaa admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.930964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eea318-5d4d-42a3-97ae-7f5134f2cbc9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:30.935493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.936130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.936407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.936674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.937341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.939357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.956482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:30.957177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:30.957460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:30.957802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:30.958523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:30.958828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:30.960985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:30.964162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 796/1575] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:30.965118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.974362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 780/1576] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:30.982169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:30.991377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c2bc4-cf8a-4724-a9a0-56c35bbc7e03 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.024715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea216ce-66ae-4b89-a4bb-c5607d77aef1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.029289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.029975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.030249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.030518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.031199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.033129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.045189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaca71-c9df-4885-a1cf-607209b76b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.045872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaca71-c9df-4885-a1cf-607209b76b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.046148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaca71-c9df-4885-a1cf-607209b76b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.046413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaca71-c9df-4885-a1cf-607209b76b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.047084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaca71-c9df-4885-a1cf-607209b76b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.048978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaca71-c9df-4885-a1cf-607209b76b0b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.058061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 797/1577] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.059065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.076174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 781/1578] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:30 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.076174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.076174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.076174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.092293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:31.093508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:31.123736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6f02-a38d-4e88-8483-669c16cf144d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.158542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 782/1579] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:31.159392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.169295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eae61-b19b-4244-ab92-013381f12cae None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.174370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4881637-8b9d-4373-89f2-99ded6addae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.175039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4881637-8b9d-4373-89f2-99ded6addae5 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.175318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4881637-8b9d-4373-89f2-99ded6addae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.175594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4881637-8b9d-4373-89f2-99ded6addae5 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.176475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4881637-8b9d-4373-89f2-99ded6addae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.180198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4881637-8b9d-4373-89f2-99ded6addae5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.188596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.189267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.189551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.189837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.190514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.192460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.202285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 783/1580] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.203622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.204006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.204313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.217499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 798/1581] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.218366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.226470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:31.227981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:31.228253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa92f3f-31f9-4155-af47-158b2f23b759 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.232665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.233305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.233578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.233875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.234541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.235406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 784/1582] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:31.238574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.238700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.245847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae99c2d-6915-4c07-a782-61f7623cbfc5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.251047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.251790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.252061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.252332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.253009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.254942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.260500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 799/1583] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.260500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.268908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807104db-4526-4756-9ab0-e06e0615376f admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.274284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.274923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.275249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.275525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.276193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.278372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.279566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 785/1584] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.280351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.300997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 800/1585] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.300997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.341842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039f6eb-b1b5-444a-852b-a08d424642bc admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.346601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.347317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.347590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.347858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.348534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.351044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.351938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23187d6a-45ad-40c4-a867-217a860cc24d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.372876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 786/1586] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.372876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.381853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29154cb-3d4e-4d8a-bc2a-44e3e7504e48 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.386445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.387082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.387354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.387625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.388326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.389975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.399491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 787/1587] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.400215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.403157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.403968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.404243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.404509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.411558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f075175-fc54-4dac-8209-61c5d2a60073 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.414849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.416333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.417648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.418358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.418632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.418900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.419607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.421702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.426101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 801/1588] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:31.426896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.434699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 788/1589] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.434699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.439213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4331-5ae1-4fd7-ae04-62736b7e9c5d service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.442933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.443073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b627168-ad30-4b04-9cad-74b8abaaff2c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.444424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.444771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.445424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.448435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.448897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.449342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.449507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.450337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.452055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.455941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.457383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.464982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 789/1590] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.465601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.471014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 802/1591] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:31.471803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.478718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb5001-90de-4408-af19-e691d7cdc476 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.481840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31abe7-5479-44af-9435-6d54d8437667 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.483933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.484672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.485105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.485404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.486252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.486940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.487665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.488003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.488336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.488658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.489176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.490921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.500999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 803/1592] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.502074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.512710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 790/1593] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:31 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:31.513079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c305b3-1d76-4071-b6b3-7e046da85a69 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.513363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.519800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.520652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.521483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.522532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.523194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.524169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd6056-9565-49a7-8a8d-543b08bf5bbe admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.525606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.529093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.529902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.530240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.530573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.531363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.533039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.537525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 804/1594] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.538625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.547568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 791/1595] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.548540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.552092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71899-f770-4dfe-9c90-7956e76fa602 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.557404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.558566 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.558846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.559110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.559389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4efafa-8e91-41ff-9dc2-68e5587d7174 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.559857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.561456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.564396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.565257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.565453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.565667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.566417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.568269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.573067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 805/1596] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.573799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.587344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd894a-4a85-467d-9c75-887424a08a87 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.587567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 792/1597] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.587567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.592598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.593441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.593859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.594263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.595098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.595361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e9b7b-c7f1-4a90-9345-33602f840c99 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.598199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.600701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.601347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.601913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.602187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.602894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.604483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.612488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 806/1598] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.612488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.618502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 793/1599] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.619110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.625662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cc878-e25d-4312-b525-db9249a509f5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.629297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb687-6677-47b8-a60a-8cba200dc825 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.631911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.632571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.632849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.633133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.633999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.635131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.635822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.636310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.636668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.637106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] PATH_INFO: `/v3/projects/4381b412569f4471a4564fda366d6d20/users/f85ab1846ce244598b1256a36cde7bf2/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.648041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 807/1600] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:31.648872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.657763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4381b412569f4471a4564fda366d6d20, user_id=f85ab1846ce244598b1256a36cde7bf2, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.659531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7480708-148f-4c13-a7f2-daab1cccef23 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.660957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.664539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.665586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.665919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.666195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] PATH_INFO: `/v3/projects/43c36b17e1414e208b453d10be94834c/users/13a6ce9b67564caab0892fc443073202/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.677681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 794/1601] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:31 2022] PUT /identity/v3/projects/4381b412569f4471a4564fda366d6d20/users/f85ab1846ce244598b1256a36cde7bf2/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:31.679231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.683696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c36b17e1414e208b453d10be94834c, user_id=13a6ce9b67564caab0892fc443073202, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.690866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.703778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 808/1602] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:31 2022] PUT /identity/v3/projects/43c36b17e1414e208b453d10be94834c/users/13a6ce9b67564caab0892fc443073202/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:31.704904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.749935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f07d68-01f0-48b5-82b2-7d5f84ac02f1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.770597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c911e35-ccd9-42ca-bbe2-2b9ff5ec515c admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.776348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.777386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.777726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.778120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] PATH_INFO: `/v3/projects/647f81a1fff4495daea84bd76383444a/users/f45e580474ea4cd7b41220444ae37b69/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.794005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=647f81a1fff4495daea84bd76383444a, user_id=f45e580474ea4cd7b41220444ae37b69, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.796974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.824237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 809/1603] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:31 2022] PUT /identity/v3/projects/647f81a1fff4495daea84bd76383444a/users/f45e580474ea4cd7b41220444ae37b69/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:31.825607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.825726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.825867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.825867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.825867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] PATH_INFO: `/v3/projects/73b0d2be745644439ae1c96c3b5044cb/users/55b4bf86f8d449158962b437cd712bf4/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.846036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b0d2be745644439ae1c96c3b5044cb, user_id=55b4bf86f8d449158962b437cd712bf4, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.849854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:31.883634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 795/1604] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:31 2022] PUT /identity/v3/projects/73b0d2be745644439ae1c96c3b5044cb/users/55b4bf86f8d449158962b437cd712bf4/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:31.884780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:31.907933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5002bd-5654-4644-9143-5cdd20dbb4ee admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:31.992598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96cf6-cb90-4e63-81f7-add321c4dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:31.993591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96cf6-cb90-4e63-81f7-add321c4dfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:31.993906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96cf6-cb90-4e63-81f7-add321c4dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:31.994180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96cf6-cb90-4e63-81f7-add321c4dfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:31.994914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96cf6-cb90-4e63-81f7-add321c4dfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:31.996766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96cf6-cb90-4e63-81f7-add321c4dfd7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.007026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4d6e6-db08-4d8c-bf71-87f3b91411bd admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.009922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 810/1605] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:32.011472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469110e4-7697-48c1-ac07-0c8294495e1d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.012209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469110e4-7697-48c1-ac07-0c8294495e1d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.013060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469110e4-7697-48c1-ac07-0c8294495e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.017713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df2a83-8938-4650-bdd2-542582d00946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.018759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2a83-8938-4650-bdd2-542582d00946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.019135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2a83-8938-4650-bdd2-542582d00946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.020374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df2a83-8938-4650-bdd2-542582d00946 admin admin] PATH_INFO: `/v3/projects/7a7482e518374643873c71ea9afb5c82/users/e004b9ccb9cc4e299b4bbe6c499f0222/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.048378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df2a83-8938-4650-bdd2-542582d00946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7482e518374643873c71ea9afb5c82, user_id=e004b9ccb9cc4e299b4bbe6c499f0222, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.049305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-469110e4-7697-48c1-ac07-0c8294495e1d None None] MFA Rules not processed for user `f85ab1846ce244598b1256a36cde7bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.051378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df2a83-8938-4650-bdd2-542582d00946 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.051508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-469110e4-7697-48c1-ac07-0c8294495e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.074437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 796/1606] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:31 2022] PUT /identity/v3/projects/7a7482e518374643873c71ea9afb5c82/users/e004b9ccb9cc4e299b4bbe6c499f0222/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:32.076457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3cd42-9f25-4b30-b330-0b2f004bf62f None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.076861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3cd42-9f25-4b30-b330-0b2f004bf62f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.077147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3cd42-9f25-4b30-b330-0b2f004bf62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.102187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-60b3cd42-9f25-4b30-b330-0b2f004bf62f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.103826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-60b3cd42-9f25-4b30-b330-0b2f004bf62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.148512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 811/1607] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.150413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.151123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.151500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.185160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 797/1608] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.186556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd8a5-01ec-444a-897d-7f147bd9ea66 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.186843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd8a5-01ec-444a-897d-7f147bd9ea66 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.187116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffd8a5-01ec-444a-897d-7f147bd9ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.204856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] MFA Rules not processed for user `f45e580474ea4cd7b41220444ae37b69`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.207511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.222983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-15ffd8a5-01ec-444a-897d-7f147bd9ea66 None None] MFA Rules not processed for user `55b4bf86f8d449158962b437cd712bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.223886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-15ffd8a5-01ec-444a-897d-7f147bd9ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.289127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 812/1609] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.290492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:32.294463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 798/1610] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.298150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.298150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.298150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.306462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7a23-d552-4e8a-a16d-6ef5bd3b37ba None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.312463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be161673-26de-4a2e-82a5-6f944fbcd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.313781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be161673-26de-4a2e-82a5-6f944fbcd8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.314158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be161673-26de-4a2e-82a5-6f944fbcd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.314492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be161673-26de-4a2e-82a5-6f944fbcd8cf admin admin] PATH_INFO: `/v3/projects/59a45b25fa9e4a4bb9e144de365602bc/users/189966fbd18f4152b6b54ba5492034e0/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.326242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] MFA Rules not processed for user `e004b9ccb9cc4e299b4bbe6c499f0222`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.327648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.330500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be161673-26de-4a2e-82a5-6f944fbcd8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a45b25fa9e4a4bb9e144de365602bc, user_id=189966fbd18f4152b6b54ba5492034e0, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.333259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be161673-26de-4a2e-82a5-6f944fbcd8cf admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.353324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 813/1611] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:32 2022] PUT /identity/v3/projects/59a45b25fa9e4a4bb9e144de365602bc/users/189966fbd18f4152b6b54ba5492034e0/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:32.355369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f55b0-9a07-44ee-8991-98014e1764e3 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.355823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f55b0-9a07-44ee-8991-98014e1764e3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.356260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f55b0-9a07-44ee-8991-98014e1764e3 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.358214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 814/1612] 10.222.0.70 () {54 vars in 961 bytes} [Mon May 16 16:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:32.358947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f55b0-9a07-44ee-8991-98014e1764e3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:32.402512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 799/1613] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.402512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:32.410317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c49198-d0ab-4d15-9c53-f417c5c49f44 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.440300 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f55b0-9a07-44ee-8991-98014e1764e3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.444047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c55b4b-9284-40ec-85ab-884420485dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.444819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c55b4b-9284-40ec-85ab-884420485dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.445100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c55b4b-9284-40ec-85ab-884420485dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.445440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c55b4b-9284-40ec-85ab-884420485dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.478125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.478902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.479184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.479448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.480131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.482095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.511414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 800/1614] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:32.511414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:32.517489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c55b4b-9284-40ec-85ab-884420485dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.519921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c55b4b-9284-40ec-85ab-884420485dd6 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.532393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 815/1615] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:32.533976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b8d0-d245-4544-bee0-7e214674ceb9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.534207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b8d0-d245-4544-bee0-7e214674ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.534546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b8d0-d245-4544-bee0-7e214674ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.575143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7d63b8d0-d245-4544-bee0-7e214674ceb9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.578160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7d63b8d0-d245-4544-bee0-7e214674ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.627180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b393451-9484-4fab-8d2c-21d9cd41d328 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.633270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b38c4-e2bc-470d-a368-4c9cbb74c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.634020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b38c4-e2bc-470d-a368-4c9cbb74c9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.634315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b38c4-e2bc-470d-a368-4c9cbb74c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.634712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b38c4-e2bc-470d-a368-4c9cbb74c9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.635476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b38c4-e2bc-470d-a368-4c9cbb74c9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.638023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b38c4-e2bc-470d-a368-4c9cbb74c9d5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.675808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 801/1616] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:32.678400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0794fe-4515-4e77-973d-fada1191c299 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.678690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0794fe-4515-4e77-973d-fada1191c299 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.678967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0794fe-4515-4e77-973d-fada1191c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.713691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ce0794fe-4515-4e77-973d-fada1191c299 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.714933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ce0794fe-4515-4e77-973d-fada1191c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.722889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 816/1617] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.724490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c3cf3-482d-4dd3-a722-eedd7b178c0f None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.727437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c3cf3-482d-4dd3-a722-eedd7b178c0f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.727727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c3cf3-482d-4dd3-a722-eedd7b178c0f None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.730708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 817/1618] 10.222.0.70 () {54 vars in 961 bytes} [Mon May 16 16:56:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:32.731488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c3cf3-482d-4dd3-a722-eedd7b178c0f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:32.846036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 802/1619] 10.222.0.70 () {58 vars in 1058 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:32.847567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.847921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.848272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.868861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c3cf3-482d-4dd3-a722-eedd7b178c0f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.874675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.875418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.875854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.876135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.877153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.879367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:32.911218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] MFA Rules not processed for user `0cfe14bbc5f34432882bf74de0536ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:32.913871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:32.925511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 818/1620] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:32.926827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:32.940242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7097bd-d0b4-45e3-892d-8a2416181fee admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:32.945668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eab07-f9c4-404a-aa4e-1aaca3c3a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:32.946474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eab07-f9c4-404a-aa4e-1aaca3c3a07d admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:32.946706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eab07-f9c4-404a-aa4e-1aaca3c3a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:32.947357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eab07-f9c4-404a-aa4e-1aaca3c3a07d admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:32.948309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eab07-f9c4-404a-aa4e-1aaca3c3a07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:32.952451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9eab07-f9c4-404a-aa4e-1aaca3c3a07d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.008616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 819/1621] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/users => generated 300 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:33.010754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.011214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.011729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.033630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:33.035642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:33.048880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 820/1622] 10.222.0.70 () {58 vars in 1058 bytes} [Mon May 16 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:33.050054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.081444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 803/1623] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:33.081444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.108237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf8d94-b670-48b5-bff3-68f7c9a79f03 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.123739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.125703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.126164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.126596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.146368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405a1a-8696-43df-8258-153296d574c0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.157251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.158201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.158640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.159079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.177835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.180603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.193077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 821/1624] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:33.194003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.212888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc358a2-8981-4948-888e-e1b9459a95b7 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.219974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.220647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.222061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.222061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.222814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.225414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.238336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.244337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 822/1625] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:33.244337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.245378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.265076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc4d0-2476-4948-9c6f-be770ce1de76 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.272898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 804/1626] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:33.278824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.291205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d25bbb-67cf-430d-aded-90839d09a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.293166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25bbb-67cf-430d-aded-90839d09a00e admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.293891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25bbb-67cf-430d-aded-90839d09a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.294173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25bbb-67cf-430d-aded-90839d09a00e admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.297853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d25bbb-67cf-430d-aded-90839d09a00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.303749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d25bbb-67cf-430d-aded-90839d09a00e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.310938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334c023-9f6d-43fe-94d6-efa750e7e61f service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.335289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.335550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 823/1627] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:33.335657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.335657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.335657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.339091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.339424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.339701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.376786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] MFA Rules not processed for user `0cfe14bbc5f34432882bf74de0536ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:33.379601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:33.398679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 824/1628] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:33.399346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.436122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df0d70-0fe8-4206-9820-3c1fc96ec3f2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.454237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.455299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.455584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.455873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] PATH_INFO: `/v3/projects/95f83100867e4021928a856b06e83b31/users/230d27ac8be84e888e45c15ab73a1c4f/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.466322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.468397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.482191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f83100867e4021928a856b06e83b31, user_id=230d27ac8be84e888e45c15ab73a1c4f, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.484426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 805/1629] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:33.486238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.501024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a57e-a226-494e-900a-7c0c9386e77f service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.501323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.509825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.511636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.512244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.512788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] PATH_INFO: `/v3/projects/2b1112f2d15945b9830031d72edc0a8b/users/003553b9d95e4aa69013eb9e379a299b/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.527336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 825/1630] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:33 2022] PUT /identity/v3/projects/95f83100867e4021928a856b06e83b31/users/230d27ac8be84e888e45c15ab73a1c4f/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:33.533003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.535377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1112f2d15945b9830031d72edc0a8b, user_id=003553b9d95e4aa69013eb9e379a299b, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.539035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.557558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 806/1631] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:33 2022] PUT /identity/v3/projects/2b1112f2d15945b9830031d72edc0a8b/users/003553b9d95e4aa69013eb9e379a299b/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:33.561774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.657531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b9e-5b7e-4bb8-800c-2239613a60d2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.688782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a06463-ec3a-447e-8826-dc85d948bd43 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.696932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.697886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.698273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.698551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.699647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.702293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.716829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 807/1632] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:56:33.720849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.734597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31170c61-4b2a-43c9-a998-cf6d06fc4960 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:33.739595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fa982-3874-406b-a630-535b90b0d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.741159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fa982-3874-406b-a630-535b90b0d484 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.741865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fa982-3874-406b-a630-535b90b0d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.742426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fa982-3874-406b-a630-535b90b0d484 admin admin] PATH_INFO: `/v3/projects/2b1112f2d15945b9830031d72edc0a8b/users/003553b9d95e4aa69013eb9e379a299b/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.744972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fa982-3874-406b-a630-535b90b0d484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1112f2d15945b9830031d72edc0a8b, user_id=003553b9d95e4aa69013eb9e379a299b, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.747760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172fa982-3874-406b-a630-535b90b0d484 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.774119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 808/1633] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:33 2022] PUT /identity/v3/projects/2b1112f2d15945b9830031d72edc0a8b/users/003553b9d95e4aa69013eb9e379a299b/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:33.786919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe448-3e7e-4366-a1de-22397882edac None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.787601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe448-3e7e-4366-a1de-22397882edac None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.788101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe448-3e7e-4366-a1de-22397882edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.835775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ab0fe448-3e7e-4366-a1de-22397882edac None None] MFA Rules not processed for user `003553b9d95e4aa69013eb9e379a299b`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:33.837474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ab0fe448-3e7e-4366-a1de-22397882edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:33.936793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59d46-dee0-4543-804a-8b7288444fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:33.937460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59d46-dee0-4543-804a-8b7288444fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.937759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59d46-dee0-4543-804a-8b7288444fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.938029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59d46-dee0-4543-804a-8b7288444fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.938765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59d46-dee0-4543-804a-8b7288444fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:33.940617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59d46-dee0-4543-804a-8b7288444fe4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:33.958581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 809/1635] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:33.958934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 826/1635] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:33.958934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5dd30-67e7-4d4b-b1d7-36e8144aeff0 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.959183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a845f17-c010-409a-96be-0ecfef1c2a38 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.959290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5dd30-67e7-4d4b-b1d7-36e8144aeff0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.959290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5dd30-67e7-4d4b-b1d7-36e8144aeff0 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.959470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a845f17-c010-409a-96be-0ecfef1c2a38 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.959470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a845f17-c010-409a-96be-0ecfef1c2a38 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.959642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 827/1636] 10.222.0.70 () {54 vars in 912 bytes} [Mon May 16 16:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:33.961103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5dd30-67e7-4d4b-b1d7-36e8144aeff0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:33.967389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 810/1637] 10.222.0.70 () {54 vars in 912 bytes} [Mon May 16 16:56:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:33.969919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6635-e16b-4137-a176-41dc0f8ec0b2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:33.970344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6635-e16b-4137-a176-41dc0f8ec0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:33.970714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6635-e16b-4137-a176-41dc0f8ec0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:33.993425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-27ea6635-e16b-4137-a176-41dc0f8ec0b2 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:33.995744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-27ea6635-e16b-4137-a176-41dc0f8ec0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:34.036080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5dd30-67e7-4d4b-b1d7-36e8144aeff0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:34.041665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:34.042716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.043001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.043270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] PATH_INFO: `/v3/projects/95f83100867e4021928a856b06e83b31/users/230d27ac8be84e888e45c15ab73a1c4f/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.045320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f83100867e4021928a856b06e83b31, user_id=230d27ac8be84e888e45c15ab73a1c4f, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:34.048487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:34.069416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 828/1638] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:33 2022] PUT /identity/v3/projects/95f83100867e4021928a856b06e83b31/users/230d27ac8be84e888e45c15ab73a1c4f/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:34.069416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:34.103257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 811/1639] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:34.104829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.105701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.106854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.135024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd6c3-0cec-48da-86a2-9c30669d01c5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:34.139499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2ee56-1661-4540-888f-48140e68d59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:34.140162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ee56-1661-4540-888f-48140e68d59f service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.140429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ee56-1661-4540-888f-48140e68d59f service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.140695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2ee56-1661-4540-888f-48140e68d59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.150743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:34.153786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:34.242238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ee56-1661-4540-888f-48140e68d59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:34.243666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2ee56-1661-4540-888f-48140e68d59f service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:34.254589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 829/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:34.255869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.256187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.256460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.282617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] MFA Rules not processed for user `230d27ac8be84e888e45c15ab73a1c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:34.283082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 812/1641] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:56:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:34.284373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:34.289996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:34.299605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fd04-8118-46b3-8673-a92023197e34 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:34.307510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:34.308996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.309374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.309775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.353793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:34.358713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:34.384815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 813/1642] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:34.386439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:34.395090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 830/1643] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:34.397093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:34.424145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469451-b71e-45fe-865a-c46fef123119 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:34.435510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037a04-2f9b-4e78-b07d-a77c7df2692b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:34.437431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037a04-2f9b-4e78-b07d-a77c7df2692b service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.437795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037a04-2f9b-4e78-b07d-a77c7df2692b service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.438569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037a04-2f9b-4e78-b07d-a77c7df2692b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.464033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037a04-2f9b-4e78-b07d-a77c7df2692b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:34.466929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037a04-2f9b-4e78-b07d-a77c7df2692b service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:34.495923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 831/1644] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:34.529366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896ab05-25fd-4d93-ae2a-d6ac442b2527 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:34.540441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:34.541445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.541860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.542235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] PATH_INFO: `/v3/users/55b4bf86f8d449158962b437cd712bf4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.543590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b4bf86f8d449158962b437cd712bf4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:34.545771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:34.641179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b4bf86f8d449158962b437cd712bf4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:34.651654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b4bf86f8d449158962b437cd712bf4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:34.666449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b4bf86f8d449158962b437cd712bf4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:34.667264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b4bf86f8d449158962b437cd712bf4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:34.697566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b4bf86f8d449158962b437cd712bf4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:34.719736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:34.720337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 814/1645] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:34 2022] DELETE /identity/v3/users/55b4bf86f8d449158962b437cd712bf4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:34.724275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:34.733817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:34.764454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:34.765726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:34.893534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 832/1646] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:34.905292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:34.907873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:35.124959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7432b1-2f6c-4b95-b91a-86c7ef010f44 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:35.143902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:35.144663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:35.144928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:35.145202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:35.166371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:35.167845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:35.184896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 815/1647] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:35.412033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:35.414767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:35.553985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ffbb3-ca1d-4e52-b1b4-e2e2c61fcd60 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:35.568553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:35.569645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:35.570727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:35.571241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:35.577845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:35.615042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:35.617930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:35.781409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:35.786157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:35.807331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55b7bd-c8a0-42de-8508-a1298228bdeb service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:35.820393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:35.822743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:35.823184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:35.823308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:35.825568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 833/1648] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:35.847137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:35.996030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:36.000528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:36.027392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 816/1649] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:36.033104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:36.043189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b3cbc-b2f7-4dcc-9215-cee15abd3364 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:36.054628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:36.055501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:36.055780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:36.056045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:36.064154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:36.182435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:36.185456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:36.207974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825fdad-679a-4d0d-964e-6309e6d448d3 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:36.216174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:36.217806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:36.219013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:36.219538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] PATH_INFO: `/v3/projects/73b0d2be745644439ae1c96c3b5044cb` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:36.222506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b0d2be745644439ae1c96c3b5044cb)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:36.223708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: WARNING py.warnings [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:56:36.223708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: warnings.warn(msg) May 16 16:56:36.223708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: May 16 16:56:36.227232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:36.269525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:36.276700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:36.305270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 834/1650] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:36.340068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b0d2be745644439ae1c96c3b5044cb', 'request_id': 'req-9293dcbc-1e5b-4fac-a23b-37448748265f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.358793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b0d2be745644439ae1c96c3b5044cb', 'request_id': 'req-9293dcbc-1e5b-4fac-a23b-37448748265f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.370070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b0d2be745644439ae1c96c3b5044cb', 'request_id': 'req-9293dcbc-1e5b-4fac-a23b-37448748265f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.430803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] The token cache is being invalidate because project 73b0d2be745644439ae1c96c3b5044cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:36.430803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.432637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9293dcbc-1e5b-4fac-a23b-37448748265f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.436894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 817/1651] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:36 2022] DELETE /identity/v3/projects/73b0d2be745644439ae1c96c3b5044cb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:56:36.440852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:36.453980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08727-4166-4cac-a590-985c9d2e4c77 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:36.524860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:36.525905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:36.526182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:36.526538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] PATH_INFO: `/v3/users/003553b9d95e4aa69013eb9e379a299b` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:36.528037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003553b9d95e4aa69013eb9e379a299b)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:36.530595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: WARNING py.warnings [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 16 16:56:36.530595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: warnings.warn(msg) May 16 16:56:36.530595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: May 16 16:56:36.532048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:36.674285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003553b9d95e4aa69013eb9e379a299b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.703739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003553b9d95e4aa69013eb9e379a299b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.717190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003553b9d95e4aa69013eb9e379a299b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.757871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003553b9d95e4aa69013eb9e379a299b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.760759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76520f4c-54c8-4c31-a959-45af658441b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003553b9d95e4aa69013eb9e379a299b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:36.770882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 835/1652] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:36 2022] DELETE /identity/v3/users/003553b9d95e4aa69013eb9e379a299b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:37.266088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5198c15-d00c-485b-ad1e-970069a8e55b None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:37.267009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5198c15-d00c-485b-ad1e-970069a8e55b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:37.267482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5198c15-d00c-485b-ad1e-970069a8e55b None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:37.269959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 818/1653] 10.222.0.70 () {54 vars in 912 bytes} [Mon May 16 16:56:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:37.277496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:37.278037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:37.278502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:37.381618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] MFA Rules not processed for user `4920e5f3dcdc4b068f4a0b3a1f9bc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:37.384865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:37.517082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 836/1654] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:37.530515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5198c15-d00c-485b-ad1e-970069a8e55b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:37.533337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b5198c15-d00c-485b-ad1e-970069a8e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:37.551500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5198c15-d00c-485b-ad1e-970069a8e55b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:37.557780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:37.558452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:37.558790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:37.559229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:37.568767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:37.570821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:37.583720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 819/1655] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:38.158626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:38.160538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:38.315764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95279c6a-0e89-4fb6-bf40-7b7ef2a2cb15 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:38.342045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:38.342815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:38.343102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:38.343414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] PATH_INFO: `/v3/projects/2b1112f2d15945b9830031d72edc0a8b` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:38.344801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1112f2d15945b9830031d72edc0a8b)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:38.350842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:38.566574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:38.566574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:38.568781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1112f2d15945b9830031d72edc0a8b', 'request_id': 'req-65f918bf-8861-47dc-b5b5-b603da324072'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.568781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1112f2d15945b9830031d72edc0a8b', 'request_id': 'req-65f918bf-8861-47dc-b5b5-b603da324072'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.568781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1112f2d15945b9830031d72edc0a8b', 'request_id': 'req-65f918bf-8861-47dc-b5b5-b603da324072'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.574214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0d07-e813-41e7-87b1-6af6fc9344b8 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:38.602698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] The token cache is being invalidate because project 2b1112f2d15945b9830031d72edc0a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:38.602698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.612914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-65f918bf-8861-47dc-b5b5-b603da324072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.616342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 837/1656] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:38 2022] DELETE /identity/v3/projects/2b1112f2d15945b9830031d72edc0a8b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:38.624443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d579-fc9a-4b7e-8a0a-bf8eeb4d0d3f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:38.626676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d579-fc9a-4b7e-8a0a-bf8eeb4d0d3f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:38.627133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d579-fc9a-4b7e-8a0a-bf8eeb4d0d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:38.689417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6b34d579-fc9a-4b7e-8a0a-bf8eeb4d0d3f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:38.690661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6b34d579-fc9a-4b7e-8a0a-bf8eeb4d0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:38.755645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:38.757383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:38.758118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:38.758596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] PATH_INFO: `/v3/users/e004b9ccb9cc4e299b4bbe6c499f0222` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:38.761650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e004b9ccb9cc4e299b4bbe6c499f0222)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:38.764371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:38.846992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 838/1657] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:38.856917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2a15a-3ea3-4ad3-b812-ddf8a8a82cd4 None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:38.857198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2a15a-3ea3-4ad3-b812-ddf8a8a82cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:38.857470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2a15a-3ea3-4ad3-b812-ddf8a8a82cd4 None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:38.863161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 839/1658] 10.222.0.70 () {54 vars in 960 bytes} [Mon May 16 16:56:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:38.867238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2157-ad7f-4cad-9d1f-68523dd5cbef None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:38.867520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2157-ad7f-4cad-9d1f-68523dd5cbef None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:38.867790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d2157-ad7f-4cad-9d1f-68523dd5cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:38.882757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e004b9ccb9cc4e299b4bbe6c499f0222'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.897548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e004b9ccb9cc4e299b4bbe6c499f0222'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.917551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e004b9ccb9cc4e299b4bbe6c499f0222'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.919148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e004b9ccb9cc4e299b4bbe6c499f0222'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.933652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-771d2157-ad7f-4cad-9d1f-68523dd5cbef None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:38.937356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-771d2157-ad7f-4cad-9d1f-68523dd5cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:38.951567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e004b9ccb9cc4e299b4bbe6c499f0222'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:38.965077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 840/1659] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:38.967873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:38.969505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:38.969818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:38.971537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 820/1660] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:38 2022] DELETE /identity/v3/users/e004b9ccb9cc4e299b4bbe6c499f0222 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:38.972558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.036342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] MFA Rules not processed for user `4147f3dfb94f49a0b6e08d16323d51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:39.039746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:39.164128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a153400-bf88-49ac-a44a-2fb387d3d0df admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.178535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.179224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.179504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.179780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.180517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:39.180826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.184693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c5c1-8df2-4976-add4-9a9cfa2b1838 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.211711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 821/1661] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:39.221153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 841/1662] 10.222.0.70 () {58 vars in 1057 bytes} [Mon May 16 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:39.222338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.223946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.224901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.226337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.249539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4815a-00d1-4efa-bb17-909135f2d427 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.260660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.261568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.262008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.262414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.263239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.265256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:39.266192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.268292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:39.289516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 822/1663] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:39.290595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.316173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dc397-8e5d-4f05-91b9-73c26cdc0b8a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.327633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 842/1664] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:39 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:39.328700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.332353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:39.336734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.337620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.337949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.338226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.346596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:39.376366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.378050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.409928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 823/1665] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:39.429885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.478934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be37c3-3f0b-42b2-96a0-1dbc5bef960c service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.547253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785168b4-9ecb-42f0-9ff9-d4e5dab4eceb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.558314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.559279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.560860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.561470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.685893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.686713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.690443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.690868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.691793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.693979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.742836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.752859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.784399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 824/1666] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:39 2022] POST /identity/v3/users => generated 301 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:39.785572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.789499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 843/1667] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:39.817499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53591b30-48c7-4288-b4c8-53a0c2074c3d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.858727 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.859528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.860057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.860532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.861467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.863327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.912911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 825/1668] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:39.916796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.930402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cb650-9f7a-4e29-b7e2-e08ec3e8488c service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:39.935778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c0ce2-2950-4b19-a035-b99a856eb60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:39.936543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0ce2-2950-4b19-a035-b99a856eb60d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:39.936823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0ce2-2950-4b19-a035-b99a856eb60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:39.937846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c0ce2-2950-4b19-a035-b99a856eb60d admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:39.938684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0ce2-2950-4b19-a035-b99a856eb60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:39.941272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c0ce2-2950-4b19-a035-b99a856eb60d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:39.964584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:39.965270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 844/1669] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:39.988585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9eb42-eeda-47b0-a87d-de0426216e10 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:40.000938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:40.002000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:40.004452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:40.004452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] PATH_INFO: `/v3/projects/fd16d6991d2a4288a688d285ba88bdc8/users/ca92d30a4b35496cbef3ad12e7a733f9/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:40.034982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd16d6991d2a4288a688d285ba88bdc8, user_id=ca92d30a4b35496cbef3ad12e7a733f9, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:40.037862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:40.082796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 826/1670] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:39 2022] PUT /identity/v3/projects/fd16d6991d2a4288a688d285ba88bdc8/users/ca92d30a4b35496cbef3ad12e7a733f9/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:40.093076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:40.093347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:40.093610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:40.146354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] MFA Rules not processed for user `ca92d30a4b35496cbef3ad12e7a733f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:40.157909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:40.275006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 845/1671] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:40.279229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:40.399812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04587418-9414-489c-9e3b-ed49beb5524b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:40.412539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:40.414679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:40.417961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:40.418507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:40.419456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:40.424867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:40.502282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 827/1672] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:40 2022] POST /identity/v3/projects => generated 399 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:40.503764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:40.520939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b12-2f47-42a8-a3b0-4a9f61a85add None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:40.658191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:40.659342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:40.659891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:40.660377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:40.661343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:40.665207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:40.703527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 846/1673] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:40 2022] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:40.704813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:40.720465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4cd59-4ca8-4073-9375-a889dfa262e1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:40.733905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:40.736162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:40.736692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:40.737771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:40.739645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:40.748573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:40.788738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 828/1674] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:40.788917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:40.810225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cfb5d-e0a0-4395-93fa-0cfd496e2f35 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:40.836276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:40.840345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:40.840746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:40.843371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] PATH_INFO: `/v3/projects/dfbeb93d12cc426a8c87612696f95af6/users/0d3440e9ff104809bdc7838d7c99e12e/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:40.891819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbeb93d12cc426a8c87612696f95af6, user_id=0d3440e9ff104809bdc7838d7c99e12e, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:40.895615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:40.929927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:40.931877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:40.933943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 847/1675] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:40 2022] PUT /identity/v3/projects/dfbeb93d12cc426a8c87612696f95af6/users/0d3440e9ff104809bdc7838d7c99e12e/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:40.942014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:40.963873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdf82f-67d6-49d3-a0bf-0400593c82dd admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:41.120131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:41.122019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.122520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.123113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] PATH_INFO: `/v3/projects/7a7482e518374643873c71ea9afb5c82` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.125645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7482e518374643873c71ea9afb5c82)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:41.130550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:41.135498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03280-6de7-4ad1-ae72-ff39c6aea8b6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:41.164680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:41.165361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.165645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.166054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.166798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:41.168457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:41.236195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7482e518374643873c71ea9afb5c82', 'request_id': 'req-10081d50-c959-4270-a3b7-a2d64e5b4f7b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:41.247297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 848/1676] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:41.254795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:41.265171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7482e518374643873c71ea9afb5c82', 'request_id': 'req-10081d50-c959-4270-a3b7-a2d64e5b4f7b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:41.276939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93a07f-cbdd-439e-b351-bb9e0d4a0209 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:41.285123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7482e518374643873c71ea9afb5c82', 'request_id': 'req-10081d50-c959-4270-a3b7-a2d64e5b4f7b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:41.318102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] The token cache is being invalidate because project 7a7482e518374643873c71ea9afb5c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:41.319499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:41.321267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-10081d50-c959-4270-a3b7-a2d64e5b4f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:41.337100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 829/1677] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:40 2022] DELETE /identity/v3/projects/7a7482e518374643873c71ea9afb5c82 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:41.344333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591efdb1-7640-41db-9060-69f52801eca5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.344898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591efdb1-7640-41db-9060-69f52801eca5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.345875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591efdb1-7640-41db-9060-69f52801eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.424977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-591efdb1-7640-41db-9060-69f52801eca5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:41.431150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-591efdb1-7640-41db-9060-69f52801eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:41.435770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949d95e-cab0-4673-8337-9ce4a9674469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:41.437065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d95e-cab0-4673-8337-9ce4a9674469 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.437485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d95e-cab0-4673-8337-9ce4a9674469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.437929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949d95e-cab0-4673-8337-9ce4a9674469 admin admin] PATH_INFO: `/v3/projects/dfbeb93d12cc426a8c87612696f95af6/users/0d3440e9ff104809bdc7838d7c99e12e/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.450734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949d95e-cab0-4673-8337-9ce4a9674469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbeb93d12cc426a8c87612696f95af6, user_id=0d3440e9ff104809bdc7838d7c99e12e, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:41.453481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949d95e-cab0-4673-8337-9ce4a9674469 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:41.475472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 849/1678] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:41 2022] PUT /identity/v3/projects/dfbeb93d12cc426a8c87612696f95af6/users/0d3440e9ff104809bdc7838d7c99e12e/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:41.477290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.477527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.477818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.486776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 830/1679] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:41.488843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.489265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.489660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.535948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:41.537784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:41.579440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] MFA Rules not processed for user `0d3440e9ff104809bdc7838d7c99e12e`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:41.580695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:41.661260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 850/1680] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:41.666837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:41.676981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129bafd-4368-49ec-b3f9-fc104a0d5655 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:41.694693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:41.695436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.695762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.695965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.696724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:41.696994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:41.699162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:41.725859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 851/1681] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:41.727064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:41.748773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3417-fb92-4827-a2a7-93ced612a72e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:41.765861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:41.766530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:41.766910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:41.767106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:41.767804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:41.769841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:41.848382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 852/1682] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:41 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:41.853225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:41.855700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 831/1683] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:41.880524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:41.883751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:42.002431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e55189-5ccd-4e9c-84b1-42bf1036519b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:42.034510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:42.035209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.035485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.035759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.036452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:42.038924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c2ad-a945-4d62-930b-80a243381f26 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:42.039107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:42.109258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 853/1684] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:41 2022] POST /identity/v3/users => generated 305 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:56:42.113801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:42.141624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c79d3f-8bff-499d-80d8-aa1ce4875dc9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:42.167726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:42.168415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.168689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.168952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.169691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:42.171364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:42.183162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:42.185689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.187796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.188165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.215396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 854/1685] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:42.219081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:42.272093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf2ac-75a6-4161-bb48-b83283ecef91 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:42.278135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:42.279776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:42.294915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 832/1686] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:42.309469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:42.309469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.310384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.310384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.310680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:42.312332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:42.361800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 855/1687] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:56:42.366765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:42.383175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949cfd-6ab0-49c5-bba4-02d8b4507816 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:42.414558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651cde8-97c0-40f3-ade7-05e2bc5356ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:42.415471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cde8-97c0-40f3-ade7-05e2bc5356ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.415753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cde8-97c0-40f3-ade7-05e2bc5356ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.416026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cde8-97c0-40f3-ade7-05e2bc5356ad admin admin] PATH_INFO: `/v3/projects/06e7044c4f7646cf83ff60af1471fce4/users/00747c080fce4d538c744a1c620ffa2f/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.504796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651cde8-97c0-40f3-ade7-05e2bc5356ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e7044c4f7646cf83ff60af1471fce4, user_id=00747c080fce4d538c744a1c620ffa2f, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:42.517951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651cde8-97c0-40f3-ade7-05e2bc5356ad admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:42.528409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:42.580993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7afcc-4f4c-4f97-ae42-990553b038e6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:42.585206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 833/1688] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:42 2022] PUT /identity/v3/projects/06e7044c4f7646cf83ff60af1471fce4/users/00747c080fce4d538c744a1c620ffa2f/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:42.598153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.600807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.600970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.725976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] MFA Rules not processed for user `00747c080fce4d538c744a1c620ffa2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:42.735003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:42.794480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:42.796265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:42.798639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:42.809848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:42.816529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:43.042545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 834/1689] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:43.043503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:43.100366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.102177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:43.140576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 856/1690] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:56:43.241485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64876cb2-524d-4f14-b53d-b1e29b809ff9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:43.254766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:43.255460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:43.255771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:43.256048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:43.258253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.269644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:43.332028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 835/1691] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:43 2022] POST /identity/v3/projects => generated 409 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:43.334264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:43.353527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b12f-1a24-4abd-b997-8dfb8c4876a5 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:43.482798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:43.484736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:43.485254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:43.485681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:43.486686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.499690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:43.562280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 857/1692] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:43 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:43.563954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:43.581357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5775d-c7d1-4d23-988e-a95611bfdc66 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:43.591468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:43.592403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:43.592826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:43.593241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:43.594167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.596270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:43.611676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 836/1693] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:43.616445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:43.631552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acda7-1899-4e58-9655-b8d9701f40ca admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:43.639119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:43.647843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:43.648387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:43.649327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] PATH_INFO: `/v3/projects/219ad44c49f1463a8b8007bf1601f76c/users/b9b804b4225e467797bfd67b88dec557/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:43.680134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=219ad44c49f1463a8b8007bf1601f76c, user_id=b9b804b4225e467797bfd67b88dec557, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.683341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:43.723557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 858/1694] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:43 2022] PUT /identity/v3/projects/219ad44c49f1463a8b8007bf1601f76c/users/b9b804b4225e467797bfd67b88dec557/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:43.728108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:43.741791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e7cf9-3d35-4284-be09-1f864d4b04a0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:43.910225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b16318-a820-4111-9136-c861524799a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:43.912463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16318-a820-4111-9136-c861524799a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:43.913232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16318-a820-4111-9136-c861524799a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:43.913514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b16318-a820-4111-9136-c861524799a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:43.920467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b16318-a820-4111-9136-c861524799a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.924363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b16318-a820-4111-9136-c861524799a6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:43.946558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:43.958427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe491-d6ce-418d-839a-c8b63cb3e4ca admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:43.959010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 837/1695] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:43.972001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:43.972918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:43.973347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:43.973945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] PATH_INFO: `/v3/projects/219ad44c49f1463a8b8007bf1601f76c/users/b9b804b4225e467797bfd67b88dec557/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:43.978701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=219ad44c49f1463a8b8007bf1601f76c, user_id=b9b804b4225e467797bfd67b88dec557, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:43.982128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:44.010262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a23fa2-5513-43e1-9fad-858647aa9eb7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:44.010554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a23fa2-5513-43e1-9fad-858647aa9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:44.010903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a23fa2-5513-43e1-9fad-858647aa9eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:44.012699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 859/1696] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:43 2022] PUT /identity/v3/projects/219ad44c49f1463a8b8007bf1601f76c/users/b9b804b4225e467797bfd67b88dec557/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:44.063771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-17a23fa2-5513-43e1-9fad-858647aa9eb7 None None] MFA Rules not processed for user `b9b804b4225e467797bfd67b88dec557`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:44.065573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-17a23fa2-5513-43e1-9fad-858647aa9eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:44.233930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 838/1697] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:44.242733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:44.385315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb5ecb-381a-4abe-85d6-0380d75c1f7a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:44.396134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:44.399341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:44.399971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:44.400733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:44.456783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:44.471887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:44.533224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 860/1698] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:44.602378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:44.603621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:44.604096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:44.665513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] MFA Rules not processed for user `13a6ce9b67564caab0892fc443073202`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:44.667216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:44.903082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 839/1699] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:44.918890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:44.920812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:45.043610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:45.062710 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c85104-29bc-416c-980e-1cf07fac93ed service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:45.067039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a753de-2ffb-4368-806c-e0822dd65f82 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:45.071330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbedabc-c783-4d3c-9c94-4a5d002b82ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:45.072018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbedabc-c783-4d3c-9c94-4a5d002b82ee service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:45.072264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbedabc-c783-4d3c-9c94-4a5d002b82ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:45.072532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbedabc-c783-4d3c-9c94-4a5d002b82ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:45.083482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf649-48ce-4909-a75c-9958819197b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:45.086120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf649-48ce-4909-a75c-9958819197b7 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:45.087214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf649-48ce-4909-a75c-9958819197b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:45.087849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf649-48ce-4909-a75c-9958819197b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:45.107944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf649-48ce-4909-a75c-9958819197b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:45.109783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf649-48ce-4909-a75c-9958819197b7 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:45.133368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 861/1700] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:45.176887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbedabc-c783-4d3c-9c94-4a5d002b82ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:45.179629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbedabc-c783-4d3c-9c94-4a5d002b82ee service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:45.192947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 840/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:45.926423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:45.931542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:45.931879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:45.989182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:45.991180 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:45.996026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:45.997858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:45.998376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:46.121858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] MFA Rules not processed for user `58633f982d3840dd88f631bcee882f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:46.127862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:46.177229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 862/1702] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:46.354910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 841/1703] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:46.370811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:46.373101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:46.423846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0901ec2-b356-4b43-8216-bc1237a54a6b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:46.449493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:46.459417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:46.459752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:46.460026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:46.503075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:46.508933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:46.583547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 863/1704] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:46.623852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:46.633987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:46.896565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103e2c0-caea-4154-ab15-11b8c4247bf3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:46.912676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b8fff-b92d-4900-b14f-a0d45ab4e81f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:46.913432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b8fff-b92d-4900-b14f-a0d45ab4e81f service swift] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:46.914176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b8fff-b92d-4900-b14f-a0d45ab4e81f service swift] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:46.916087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b8fff-b92d-4900-b14f-a0d45ab4e81f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:46.944380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b8fff-b92d-4900-b14f-a0d45ab4e81f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:46.952088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b8fff-b92d-4900-b14f-a0d45ab4e81f service swift] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:46.953222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:46.954934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:47.006519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 842/1705] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 16:56:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 16:56:47.211688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f9fbd-52c6-46d0-9873-ebe27129edbe service nova] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:47.236106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:47.238453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:47.243966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:47.248122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] PATH_INFO: `/v3/users/f85ab1846ce244598b1256a36cde7bf2` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:47.252810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85ab1846ce244598b1256a36cde7bf2)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:47.256192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:47.394667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85ab1846ce244598b1256a36cde7bf2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:47.418136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85ab1846ce244598b1256a36cde7bf2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:47.431292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85ab1846ce244598b1256a36cde7bf2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:47.501480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85ab1846ce244598b1256a36cde7bf2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:47.506485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85ab1846ce244598b1256a36cde7bf2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:47.524779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 864/1706] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:46 2022] DELETE /identity/v3/users/f85ab1846ce244598b1256a36cde7bf2 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:56:47.526061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:47.526597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:47.526796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:47.606470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:47.607773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:47.817358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 843/1707] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:47.946678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:47.948445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:48.164536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22087191-ea33-4d55-98f7-6480aeeb94f1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:48.171612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ea250-2be5-472d-9286-9b6d0746cda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:48.172363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ea250-2be5-472d-9286-9b6d0746cda9 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:48.172664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ea250-2be5-472d-9286-9b6d0746cda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:48.173134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ea250-2be5-472d-9286-9b6d0746cda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:48.188626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ea250-2be5-472d-9286-9b6d0746cda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:48.190681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ea250-2be5-472d-9286-9b6d0746cda9 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:48.209995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 865/1708] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:49.468127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:49.469977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:49.501582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27570aba-503f-43d1-80e0-15ac2f476ca4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:49.514434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:49.515322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:49.515599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:49.515869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] PATH_INFO: `/v3/projects/4381b412569f4471a4564fda366d6d20` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:49.527122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4381b412569f4471a4564fda366d6d20)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:49.529397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:49.701913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4381b412569f4471a4564fda366d6d20', 'request_id': 'req-8ccf6e68-47aa-416b-9754-031c72e755c1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:49.743796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4381b412569f4471a4564fda366d6d20', 'request_id': 'req-8ccf6e68-47aa-416b-9754-031c72e755c1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:49.761017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4381b412569f4471a4564fda366d6d20', 'request_id': 'req-8ccf6e68-47aa-416b-9754-031c72e755c1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:49.791775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] The token cache is being invalidate because project 4381b412569f4471a4564fda366d6d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:49.792072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:49.792956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8ccf6e68-47aa-416b-9754-031c72e755c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:49.797816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 844/1709] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:49 2022] DELETE /identity/v3/projects/4381b412569f4471a4564fda366d6d20 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:49.799588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c1d6d-2b29-4c45-a9e9-a160cc129af7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:49.800080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c1d6d-2b29-4c45-a9e9-a160cc129af7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:49.800159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c1d6d-2b29-4c45-a9e9-a160cc129af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:49.836889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-dc8c1d6d-2b29-4c45-a9e9-a160cc129af7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:49.838610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dc8c1d6d-2b29-4c45-a9e9-a160cc129af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:49.888785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:49.889130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:49.889481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:49.931576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] MFA Rules not processed for user `189966fbd18f4152b6b54ba5492034e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:49.933225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:49.996095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 866/1710] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:49.997586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:49.997924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.008333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.019372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 845/1711] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:50.041535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.043245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:50.059274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:50.060492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:50.086654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 867/1712] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:50.087602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.126338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aec27-b130-400c-a9dc-b6f918d81adc None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.152202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.154057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.154459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.154835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.155675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:56:50.156079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.157937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.184764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bdab8-bf19-4855-9c6c-9ab58dd8e642 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.193574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 868/1713] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:56:50.195236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.211891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.212514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.212798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.216381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.240758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ccea-6aa6-4e61-b810-b49be20d3284 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.254921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.256767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.257248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.258674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.259459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.259631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.271856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.273123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.313132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 846/1714] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:50.355679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 869/1715] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:50 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:50.358330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.371822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e59c6c-c919-41a5-9297-a1239ea028f6 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.493404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.495085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.495717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.496001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.496730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.498716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.549898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 847/1716] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:50 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:50.556458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.573800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2ebc-03e4-4c38-815f-0f7a4a773f05 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.585435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.587359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.587669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.588171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.589185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.591526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.613580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 870/1717] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:50.614530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.629015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8daa4-db48-4321-baf5-af3e2021fdeb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.641242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdfc5d-b48f-4776-a25b-5973a3839939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.643564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfc5d-b48f-4776-a25b-5973a3839939 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.644175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfc5d-b48f-4776-a25b-5973a3839939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.644653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfc5d-b48f-4776-a25b-5973a3839939 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.646132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdfc5d-b48f-4776-a25b-5973a3839939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.650923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdfc5d-b48f-4776-a25b-5973a3839939 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.666407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 848/1718] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:56:50.673437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:50.687385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72af3-a44b-4d5a-b68b-ff738d3560eb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:50.696679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dcab9-c171-4e12-801a-a6792f390a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:50.697732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dcab9-c171-4e12-801a-a6792f390a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.698117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dcab9-c171-4e12-801a-a6792f390a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.698466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dcab9-c171-4e12-801a-a6792f390a05 admin admin] PATH_INFO: `/v3/projects/1f0b4ff052bd4409bcde4b1d818a1990/users/abb56c5e84ea48beb148070912d761e3/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.712013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86036-335b-4b76-bff1-0b9983e9a09f None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.712267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86036-335b-4b76-bff1-0b9983e9a09f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.712564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86036-335b-4b76-bff1-0b9983e9a09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.784489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dcab9-c171-4e12-801a-a6792f390a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0b4ff052bd4409bcde4b1d818a1990, user_id=abb56c5e84ea48beb148070912d761e3, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:50.786500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-bfb86036-335b-4b76-bff1-0b9983e9a09f None None] MFA Rules not processed for user `13a6ce9b67564caab0892fc443073202`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:50.790890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bfb86036-335b-4b76-bff1-0b9983e9a09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:50.792200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dcab9-c171-4e12-801a-a6792f390a05 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:50.858957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 871/1719] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:50 2022] PUT /identity/v3/projects/1f0b4ff052bd4409bcde4b1d818a1990/users/abb56c5e84ea48beb148070912d761e3/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:50.863444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:50.866778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:50.866933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:50.942096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] MFA Rules not processed for user `abb56c5e84ea48beb148070912d761e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:50.946339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:50.987832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 849/1720] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:51.091236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:51.091904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:51.092948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:51.169905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] MFA Rules not processed for user `4920e5f3dcdc4b068f4a0b3a1f9bc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:51.174957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:51.178040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 872/1721] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:51.188469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:51.369003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 850/1722] 10.222.0.57 () {58 vars in 1015 bytes} [Mon May 16 16:56:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:51.459969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:51.462121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:51.493079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950674e-2fa2-4eec-8a15-b71fc5f0debe None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:51.499086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4101af-484d-4008-9777-1fff0c254ae3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:51.519539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:51.520542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:51.521938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:51.522888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614494-101f-4c06-9094-502323054b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:51.524518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:51.525561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614494-101f-4c06-9094-502323054b26 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:51.525894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:51.526450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614494-101f-4c06-9094-502323054b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:51.527721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614494-101f-4c06-9094-502323054b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:51.529992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:51.568777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49614494-101f-4c06-9094-502323054b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:51.579892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 873/1723] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:56:51 2022] POST /identity/v3/projects => generated 365 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:51.581188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:51.593066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49614494-101f-4c06-9094-502323054b26 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:51.613676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 851/1724] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:56:51.730416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b70bb3-0dad-4d6e-a3b5-65f03c713223 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:51.744482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:51.745604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:51.746076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:51.746507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:51.747867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:51.750047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:51.791488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 874/1725] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:56:51 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:56:51.799183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614494-101f-4c06-9094-502323054b26 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:51.858520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614494-101f-4c06-9094-502323054b26 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:51.882216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:51.885684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:51.887365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:51.888377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:51.891549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:51.900116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:51.951998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 852/1726] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:56:51.956064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:51.977052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e17e86-da4e-46c1-be5f-023c248288a0 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:51.997674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:51.998855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:51.999309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:51.999961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] PATH_INFO: `/v3/projects/b4238daa1bb246229d84c4672e6ff85c/users/e1f795b57b4541538c27ebafaa06b4fc/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:52.071775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4238daa1bb246229d84c4672e6ff85c, user_id=e1f795b57b4541538c27ebafaa06b4fc, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:52.074830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:52.127918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 875/1727] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:51 2022] PUT /identity/v3/projects/b4238daa1bb246229d84c4672e6ff85c/users/e1f795b57b4541538c27ebafaa06b4fc/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:52.129228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:52.149163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fc1a1-89e6-4fda-8a4b-ba6594a6aff0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:52.333181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058037d-5ef9-4c64-b06a-1885adeffe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:52.339994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058037d-5ef9-4c64-b06a-1885adeffe1a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:52.340333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058037d-5ef9-4c64-b06a-1885adeffe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:52.342033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058037d-5ef9-4c64-b06a-1885adeffe1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:52.342945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058037d-5ef9-4c64-b06a-1885adeffe1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:52.353169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058037d-5ef9-4c64-b06a-1885adeffe1a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:52.392817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 853/1728] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:56:52.394743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:52.408982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088dd49-aff4-475d-b185-14c7853508f4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:52.455295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:52.457732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:52.458272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:52.461109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] PATH_INFO: `/v3/projects/b4238daa1bb246229d84c4672e6ff85c/users/e1f795b57b4541538c27ebafaa06b4fc/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:52.465530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4238daa1bb246229d84c4672e6ff85c, user_id=e1f795b57b4541538c27ebafaa06b4fc, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:52.473614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:52.540925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 876/1729] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:56:52 2022] PUT /identity/v3/projects/b4238daa1bb246229d84c4672e6ff85c/users/e1f795b57b4541538c27ebafaa06b4fc/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:52.542112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:52.543105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:52.543595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:52.607324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] MFA Rules not processed for user `e1f795b57b4541538c27ebafaa06b4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:52.608810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:52.737419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:52.739888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:52.793460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 854/1730] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:52.928844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:52.930484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:53.035210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea169f9d-ccdd-4ef2-ad4b-058977a34483 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:53.057010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:53.057940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:53.058220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:53.058492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] PATH_INFO: `/v3/users/f45e580474ea4cd7b41220444ae37b69` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:53.068989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45e580474ea4cd7b41220444ae37b69)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:53.075957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:53.197620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ae4db-65b9-45a2-a86c-e8d7047f69f6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:53.222738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17ecc-7971-4219-abf0-ce36c461bfe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:53.223420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17ecc-7971-4219-abf0-ce36c461bfe6 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:53.226632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17ecc-7971-4219-abf0-ce36c461bfe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:53.226856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17ecc-7971-4219-abf0-ce36c461bfe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:53.274987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17ecc-7971-4219-abf0-ce36c461bfe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:53.276555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17ecc-7971-4219-abf0-ce36c461bfe6 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:53.277828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45e580474ea4cd7b41220444ae37b69'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:53.311109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45e580474ea4cd7b41220444ae37b69'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:53.343440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45e580474ea4cd7b41220444ae37b69'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:53.356213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 855/1731] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:56:53.402574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45e580474ea4cd7b41220444ae37b69'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:53.416938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45e580474ea4cd7b41220444ae37b69'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:53.453898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 877/1732] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:52 2022] DELETE /identity/v3/users/f45e580474ea4cd7b41220444ae37b69 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:53.455994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:53.456334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:53.456667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:53.517432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:53.528134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:53.722905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 856/1733] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:53.774472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:53.775914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:53.779767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:53.781210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:53.821623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd5f1a-61b8-4951-a568-850e74849238 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:53.852656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:53.856801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:53.857211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:53.857397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] PATH_INFO: `/v3/users/ca92d30a4b35496cbef3ad12e7a733f9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:53.870077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca92d30a4b35496cbef3ad12e7a733f9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:53.872047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:53.920656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a3861-d226-4933-80c2-0a6c918fa01e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:53.929537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926c7c-e8cc-4cc6-bdd9-1726a3f4f9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:53.930915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926c7c-e8cc-4cc6-bdd9-1726a3f4f9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:53.931496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926c7c-e8cc-4cc6-bdd9-1726a3f4f9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:53.932040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926c7c-e8cc-4cc6-bdd9-1726a3f4f9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:53.962332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e926c7c-e8cc-4cc6-bdd9-1726a3f4f9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:53.968063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e926c7c-e8cc-4cc6-bdd9-1726a3f4f9d1 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:53.988947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 857/1734] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:54.039727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca92d30a4b35496cbef3ad12e7a733f9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.057361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca92d30a4b35496cbef3ad12e7a733f9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.084509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca92d30a4b35496cbef3ad12e7a733f9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.103768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca92d30a4b35496cbef3ad12e7a733f9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.112445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca92d30a4b35496cbef3ad12e7a733f9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.135188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 878/1735] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:53 2022] DELETE /identity/v3/users/ca92d30a4b35496cbef3ad12e7a733f9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:54.140891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:54.141150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:54.141445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:54.214384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:54.218139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:54.480091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 858/1736] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:54.551900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:54.554121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:54.615956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:54.622872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:54.674354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d951c-f381-4444-b880-ba67733b2361 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:54.707333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d9bc1-aefd-4580-b8ac-721f334c8a54 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:54.710873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:54.711998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:54.712438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:54.712864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] PATH_INFO: `/v3/users/abb56c5e84ea48beb148070912d761e3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:54.715762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb56c5e84ea48beb148070912d761e3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:54.717964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:54.718902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126fef2-c88a-4165-8a04-9cddc4f31454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:54.719824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126fef2-c88a-4165-8a04-9cddc4f31454 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:54.721111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126fef2-c88a-4165-8a04-9cddc4f31454 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:54.721911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126fef2-c88a-4165-8a04-9cddc4f31454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:54.762880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126fef2-c88a-4165-8a04-9cddc4f31454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:54.765769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126fef2-c88a-4165-8a04-9cddc4f31454 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:54.811097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 879/1737] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:54.894271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb56c5e84ea48beb148070912d761e3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.918164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb56c5e84ea48beb148070912d761e3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.934240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb56c5e84ea48beb148070912d761e3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.935353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb56c5e84ea48beb148070912d761e3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:54.965492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bfa940a3-1d59-4ab6-9da8-f8c70bbd2e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb56c5e84ea48beb148070912d761e3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:55.006507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 859/1738] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:54 2022] DELETE /identity/v3/users/abb56c5e84ea48beb148070912d761e3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:56:55.012035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:55.012354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:55.012631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:55.119326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:55.121035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:55.373768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751b8d-1075-4447-9609-fa59db39261c None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:55.374900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751b8d-1075-4447-9609-fa59db39261c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:55.375333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751b8d-1075-4447-9609-fa59db39261c None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:55.377295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 860/1739] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:55.435313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:55.435598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:55.435878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:55.463515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 880/1740] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:55.467295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:55.468547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:55.640092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:55.641513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:55.767838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 861/1741] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:55.872115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69488c-ca3a-4111-b9be-2c947fb51b7b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:55.884721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:55.885485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:55.885906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:55.886252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:55.900094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:55.901563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:55.925803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc13a3-d6be-4572-96ed-0921f89b1f42 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:55.929631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:55.931820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:55.946525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fcd46-9cad-48a9-ad98-fae26570e1bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:55.947199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcd46-9cad-48a9-ad98-fae26570e1bf service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:55.947480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcd46-9cad-48a9-ad98-fae26570e1bf service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:55.947754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fcd46-9cad-48a9-ad98-fae26570e1bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:55.964313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 881/1742] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:56:55.966228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcd46-9cad-48a9-ad98-fae26570e1bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:55.967879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fcd46-9cad-48a9-ad98-fae26570e1bf service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:56.015472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 862/1743] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:56:56.610921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:56.612184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:56.647063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51d551-2e9f-4150-a560-700ab105560e service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:56.654048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:56.655474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:56.656212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:56.656973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] PATH_INFO: `/v3/users/00747c080fce4d538c744a1c620ffa2f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:56.662538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00747c080fce4d538c744a1c620ffa2f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:56.665340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:56.797460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00747c080fce4d538c744a1c620ffa2f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:56.814754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00747c080fce4d538c744a1c620ffa2f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:56.827512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00747c080fce4d538c744a1c620ffa2f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:56.848734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00747c080fce4d538c744a1c620ffa2f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:56.862821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00747c080fce4d538c744a1c620ffa2f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:56.888965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 882/1744] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:56 2022] DELETE /identity/v3/users/00747c080fce4d538c744a1c620ffa2f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:56.890602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8e8c-9cf6-49ff-aaa2-8e1d2e4782e8 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:56.890891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8e8c-9cf6-49ff-aaa2-8e1d2e4782e8 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:56.891171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8e8c-9cf6-49ff-aaa2-8e1d2e4782e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:56.926318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-eb8a8e8c-9cf6-49ff-aaa2-8e1d2e4782e8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:56.934009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-eb8a8e8c-9cf6-49ff-aaa2-8e1d2e4782e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:57.087432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 863/1745] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:57.124300 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:57.125809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:57.215762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8f64d-5f33-4ed7-87f2-75186316ca84 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:57.220240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaae06-d1c2-4573-bf44-defcdab3e084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:57.222084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaae06-d1c2-4573-bf44-defcdab3e084 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:57.222223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaae06-d1c2-4573-bf44-defcdab3e084 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:57.222445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaae06-d1c2-4573-bf44-defcdab3e084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:57.244328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaae06-d1c2-4573-bf44-defcdab3e084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:57.246155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaae06-d1c2-4573-bf44-defcdab3e084 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:57.308096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:57.308410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:57.308671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:57.323004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 883/1746] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:56:57.347971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] MFA Rules not processed for user `58633f982d3840dd88f631bcee882f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:57.354862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:57.598086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 864/1747] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:56:57.707167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:57.707620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:57.711665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:57.823866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] MFA Rules not processed for user `189966fbd18f4152b6b54ba5492034e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:57.827241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:58.145726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 884/1748] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:56:58.188869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:58.190611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:58.233543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2856a-4805-4095-8948-86160fd3a358 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:58.261964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:58.263477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:58.265908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:58.266367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] PATH_INFO: `/v3/projects/1f0b4ff052bd4409bcde4b1d818a1990` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:58.269877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0b4ff052bd4409bcde4b1d818a1990)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:58.271912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:58.479542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0b4ff052bd4409bcde4b1d818a1990', 'request_id': 'req-815133ee-2870-4ae8-a0cf-ff78e29d11c4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:58.499676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0b4ff052bd4409bcde4b1d818a1990', 'request_id': 'req-815133ee-2870-4ae8-a0cf-ff78e29d11c4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:58.531566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0b4ff052bd4409bcde4b1d818a1990', 'request_id': 'req-815133ee-2870-4ae8-a0cf-ff78e29d11c4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:58.576934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:58.578669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:58.612516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] The token cache is being invalidate because project 1f0b4ff052bd4409bcde4b1d818a1990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:58.612830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:58.617303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:58.623703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 865/1749] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:58 2022] DELETE /identity/v3/projects/1f0b4ff052bd4409bcde4b1d818a1990 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:58.639119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:58.639924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db305def-e7ae-48e6-ac04-eef8a7a3623d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:58.648852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:58.848384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:58.851051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:58.855403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:58.855775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] PATH_INFO: `/v3/projects/647f81a1fff4495daea84bd76383444a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:58.870984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647f81a1fff4495daea84bd76383444a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:58.876485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:58.936893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815133ee-2870-4ae8-a0cf-ff78e29d11c4 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:58.980328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:58.981237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:58.982057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:58.982337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] PATH_INFO: `/v3/users/e1f795b57b4541538c27ebafaa06b4fc` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:58.983760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f795b57b4541538c27ebafaa06b4fc)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:58.987025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:59.073922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647f81a1fff4495daea84bd76383444a', 'request_id': 'req-f058c043-98fd-424a-b876-7ebcb2e34d79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.100206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f795b57b4541538c27ebafaa06b4fc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.106847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647f81a1fff4495daea84bd76383444a', 'request_id': 'req-f058c043-98fd-424a-b876-7ebcb2e34d79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.119333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647f81a1fff4495daea84bd76383444a', 'request_id': 'req-f058c043-98fd-424a-b876-7ebcb2e34d79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.127259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f795b57b4541538c27ebafaa06b4fc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.147748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f795b57b4541538c27ebafaa06b4fc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.148674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f795b57b4541538c27ebafaa06b4fc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.157538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] The token cache is being invalidate because project 647f81a1fff4495daea84bd76383444a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:59.157849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.164303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.170446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 885/1750] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:58 2022] DELETE /identity/v3/projects/647f81a1fff4495daea84bd76383444a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:59.178469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:59.184467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f795b57b4541538c27ebafaa06b4fc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.190661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:59.202995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 866/1751] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:58 2022] DELETE /identity/v3/users/e1f795b57b4541538c27ebafaa06b4fc => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:59.366899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:59.368367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:59.440191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c043-98fd-424a-b876-7ebcb2e34d79 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:59.560199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf19de-4b7f-40eb-bedb-56c1146f37d8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:56:59.563645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:59.565869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:59.566689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:59.567372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] PATH_INFO: `/v3/users/230d27ac8be84e888e45c15ab73a1c4f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:59.569998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:56:59.571619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230d27ac8be84e888e45c15ab73a1c4f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:59.573519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:59.578043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:59.578586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:59.579001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] PATH_INFO: `/v3/projects/fd16d6991d2a4288a688d285ba88bdc8` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:59.582659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd16d6991d2a4288a688d285ba88bdc8)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:56:59.586377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:56:59.707459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd16d6991d2a4288a688d285ba88bdc8', 'request_id': 'req-93438c07-03b7-4eaf-acdf-092a6c9612e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.722915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd16d6991d2a4288a688d285ba88bdc8', 'request_id': 'req-93438c07-03b7-4eaf-acdf-092a6c9612e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.726627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230d27ac8be84e888e45c15ab73a1c4f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.744558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd16d6991d2a4288a688d285ba88bdc8', 'request_id': 'req-93438c07-03b7-4eaf-acdf-092a6c9612e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.752618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230d27ac8be84e888e45c15ab73a1c4f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.774697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230d27ac8be84e888e45c15ab73a1c4f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.818855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] The token cache is being invalidate because project fd16d6991d2a4288a688d285ba88bdc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:56:59.819653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.821509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-93438c07-03b7-4eaf-acdf-092a6c9612e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.832227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 867/1752] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:56:59 2022] DELETE /identity/v3/projects/fd16d6991d2a4288a688d285ba88bdc8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:59.836609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230d27ac8be84e888e45c15ab73a1c4f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.837698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78bfb641-f119-4b5c-aa2a-18548fef7ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230d27ac8be84e888e45c15ab73a1c4f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:56:59.838470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea0c9-f523-4b6f-9008-3c7a47325f37 None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:59.838747 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea0c9-f523-4b6f-9008-3c7a47325f37 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:59.841568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea0c9-f523-4b6f-9008-3c7a47325f37 None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:59.847446 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 868/1753] 10.222.0.70 () {54 vars in 912 bytes} [Mon May 16 16:56:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:56:59.855069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea0c9-f523-4b6f-9008-3c7a47325f37 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:56:59.855069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b61ea0c9-f523-4b6f-9008-3c7a47325f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:56:59.863806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 886/1754] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:59 2022] DELETE /identity/v3/users/230d27ac8be84e888e45c15ab73a1c4f => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:56:59.868747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:56:59.873105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:56:59.873584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:56:59.949448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] MFA Rules not processed for user `4920e5f3dcdc4b068f4a0b3a1f9bc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:56:59.951151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:00.051507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea0c9-f523-4b6f-9008-3c7a47325f37 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:00.076817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:00.078338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:00.078621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:00.078893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] PATH_INFO: `/v3/users/0d3440e9ff104809bdc7838d7c99e12e` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:00.084276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3440e9ff104809bdc7838d7c99e12e)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:00.090220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:00.092222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 887/1755] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:00.093163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:00.100143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:00.129224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2db5e-33b1-40c0-9077-d2d01c74e363 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:00.142526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:00.144628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:00.147616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:00.148014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] PATH_INFO: `/v3/projects/06e7044c4f7646cf83ff60af1471fce4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:00.152626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e7044c4f7646cf83ff60af1471fce4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:00.159770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:00.188465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3440e9ff104809bdc7838d7c99e12e'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.205833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3440e9ff104809bdc7838d7c99e12e'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.227761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3440e9ff104809bdc7838d7c99e12e'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.228860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3440e9ff104809bdc7838d7c99e12e'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.309289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3440e9ff104809bdc7838d7c99e12e'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.349505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 869/1756] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:56:59 2022] DELETE /identity/v3/users/0d3440e9ff104809bdc7838d7c99e12e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:00.349505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:00.354514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e7044c4f7646cf83ff60af1471fce4', 'request_id': 'req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.359529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:00.368988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e7044c4f7646cf83ff60af1471fce4', 'request_id': 'req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.381182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e7044c4f7646cf83ff60af1471fce4', 'request_id': 'req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.407529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] The token cache is being invalidate because project 06e7044c4f7646cf83ff60af1471fce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:00.407754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.430977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.437102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 888/1757] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:00 2022] DELETE /identity/v3/projects/06e7044c4f7646cf83ff60af1471fce4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:00.443489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:00.447737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:00.489079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035129b-9512-4cf6-9eea-6dca49ad19c2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:00.503460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:00.504396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:00.504865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:00.505388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:00.509769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:00.532255 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:00.534234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:00.576803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 870/1758] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:00.650596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e961fb-80ef-4db5-8e77-7d03eb55efe7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:00.710364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:00.718188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:00.776778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:00.793326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:00.793622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:00.793973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] PATH_INFO: `/v3/users/b9b804b4225e467797bfd67b88dec557` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:00.796449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b804b4225e467797bfd67b88dec557)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:00.798673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:00.860650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8588f5-b840-43d3-97a9-e0adfec95a6d service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:00.874009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:00.874902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:00.875184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:00.875492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] PATH_INFO: `/v3/projects/b4238daa1bb246229d84c4672e6ff85c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:00.876985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4238daa1bb246229d84c4672e6ff85c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:00.884722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:00.907341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b804b4225e467797bfd67b88dec557'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.926413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b804b4225e467797bfd67b88dec557'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.941765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b804b4225e467797bfd67b88dec557'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.967756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b804b4225e467797bfd67b88dec557'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.969910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4488164d-53b2-4869-bef2-097f88dc804d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b804b4225e467797bfd67b88dec557'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.974942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4238daa1bb246229d84c4672e6ff85c', 'request_id': 'req-002fae9b-2cd1-48b4-a738-2d634581a3f5'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:00.986717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 889/1759] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:00 2022] DELETE /identity/v3/users/b9b804b4225e467797bfd67b88dec557 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:00.992153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4238daa1bb246229d84c4672e6ff85c', 'request_id': 'req-002fae9b-2cd1-48b4-a738-2d634581a3f5'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:01.007622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4238daa1bb246229d84c4672e6ff85c', 'request_id': 'req-002fae9b-2cd1-48b4-a738-2d634581a3f5'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:01.022938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] The token cache is being invalidate because project b4238daa1bb246229d84c4672e6ff85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:01.023483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:01.024329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-002fae9b-2cd1-48b4-a738-2d634581a3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:01.026661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 871/1760] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:00 2022] DELETE /identity/v3/projects/b4238daa1bb246229d84c4672e6ff85c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:01.031550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.031892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.032185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.073039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:01.079674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:01.203030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 890/1761] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:01.212028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.212516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.212604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.256320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:01.261520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:01.273315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 872/1762] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:01.278102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:01.290337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546cd15-d447-44e1-8580-c0e9741e16ba None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:01.295631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:01.296542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.296980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.297400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.298322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:01.298871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:01.300646 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:01.334289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 891/1763] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:01.338582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:01.369985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a1554-30bb-46da-b697-6f11d9074ee2 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:01.378444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:01.379381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.379713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.379988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.381122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:01.384685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:01.435241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 873/1764] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:01 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:01.439414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:01.464947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30e74f-5418-4eff-8c9e-36484baa6d7d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:01.595037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:01.595778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.596058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.596329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.597097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:01.599753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:01.670683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 892/1765] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:01 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:01.673426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:01.688595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340160-03b9-4ea0-ac77-204e0608feb2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:01.704155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:01.704853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.705131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.705401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.706825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:01.711174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:01.738753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:01.742299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 874/1766] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:01.756805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e1492-0d6f-460b-8fdb-3719e074b70f admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:01.763051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648671-f38d-46a5-9e31-a206f18ccdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:01.764104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648671-f38d-46a5-9e31-a206f18ccdcc admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.764621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648671-f38d-46a5-9e31-a206f18ccdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.765043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648671-f38d-46a5-9e31-a206f18ccdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.766013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648671-f38d-46a5-9e31-a206f18ccdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:01.767925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648671-f38d-46a5-9e31-a206f18ccdcc admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:01.782575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 893/1767] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:01.790398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:01.807038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6b8e9-f6eb-4b1e-93a1-71e7626f5cce admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:01.813296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:01.820814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.821097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.821374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] PATH_INFO: `/v3/projects/72e65bd4fb3d4707af3480f94912a0bd/users/a3a6487be58c42f59906034f8f7dee54/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.861235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e65bd4fb3d4707af3480f94912a0bd, user_id=a3a6487be58c42f59906034f8f7dee54, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:01.865295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:01.909200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 875/1768] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:01 2022] PUT /identity/v3/projects/72e65bd4fb3d4707af3480f94912a0bd/users/a3a6487be58c42f59906034f8f7dee54/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:01.909605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:01.910104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:01.910311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:01.965263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] MFA Rules not processed for user `a3a6487be58c42f59906034f8f7dee54`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:01.969512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.070150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 894/1769] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:02.077048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.181718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.183695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.185731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f7a0-fd18-4e19-b3c5-83bcc93c5b32 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.197025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:02.198960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.199245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.200720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.201482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:02.206741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:02.214819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acd42b-0e38-4a8a-b06e-c8176e8a3a75 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.247075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:02.251074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.252446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.256013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] PATH_INFO: `/v3/projects/95f83100867e4021928a856b06e83b31` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.259989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f83100867e4021928a856b06e83b31)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:02.265957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:02.266169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 876/1770] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:02 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:02.267122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.402500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f83100867e4021928a856b06e83b31', 'request_id': 'req-6fd7e399-bab1-44b8-a57c-5e4258a9305f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.431178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f83100867e4021928a856b06e83b31', 'request_id': 'req-6fd7e399-bab1-44b8-a57c-5e4258a9305f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.450766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f83100867e4021928a856b06e83b31', 'request_id': 'req-6fd7e399-bab1-44b8-a57c-5e4258a9305f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.462612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27243b-5202-4dd1-94d0-0cbc39877447 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.467183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] The token cache is being invalidate because project 95f83100867e4021928a856b06e83b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:02.467473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.468196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6fd7e399-bab1-44b8-a57c-5e4258a9305f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.473508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 895/1771] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:02 2022] DELETE /identity/v3/projects/95f83100867e4021928a856b06e83b31 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:02.476007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.476574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.476848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.542482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:02.543860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.619898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:02.620895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.621322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.621941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.622784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:02.625138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:02.673118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 877/1772] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:02 2022] POST /identity/v3/users => generated 290 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:02.675758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.680987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.694284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 896/1773] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:02.695370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.705527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.719849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f796d-204b-4165-ab56-9d8dc892f156 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.720055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743759e9-4071-4220-9c9f-cd32085e604f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.727261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738487f-9914-4a0e-8db3-b3b96b5058c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:02.728082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738487f-9914-4a0e-8db3-b3b96b5058c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.728208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:02.728542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738487f-9914-4a0e-8db3-b3b96b5058c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.728962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.729298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.729582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] PATH_INFO: `/v3/projects/dfbeb93d12cc426a8c87612696f95af6` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.733073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738487f-9914-4a0e-8db3-b3b96b5058c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.734379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738487f-9914-4a0e-8db3-b3b96b5058c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:02.737871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbeb93d12cc426a8c87612696f95af6)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:02.739964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:02.743396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738487f-9914-4a0e-8db3-b3b96b5058c4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:02.760555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 897/1774] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:02.762592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.763082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.763586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.807069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:02.808428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.821335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 898/1775] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:02.825566 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.839417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8e68c-5b05-4c35-866c-dc6e2209b0c8 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.870516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbeb93d12cc426a8c87612696f95af6', 'request_id': 'req-74d81a25-858d-45a8-bd92-dabab7da4667'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.888263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbeb93d12cc426a8c87612696f95af6', 'request_id': 'req-74d81a25-858d-45a8-bd92-dabab7da4667'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.901771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbeb93d12cc426a8c87612696f95af6', 'request_id': 'req-74d81a25-858d-45a8-bd92-dabab7da4667'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.910940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c7f91-ad2a-4a5f-8604-0f6382baff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:02.912149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7f91-ad2a-4a5f-8604-0f6382baff59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.912508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7f91-ad2a-4a5f-8604-0f6382baff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.912848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7f91-ad2a-4a5f-8604-0f6382baff59 admin admin] PATH_INFO: `/v3/projects/98cf31d39f804a4686b5d1d5c7e1cdef/users/22c51581bff645b9a86bb2cb65b9b5bc/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:02.935802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] The token cache is being invalidate because project dfbeb93d12cc426a8c87612696f95af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:02.936127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.936835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:02.941772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 878/1776] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:02 2022] DELETE /identity/v3/projects/dfbeb93d12cc426a8c87612696f95af6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:02.941772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:02.941772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:02.949398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7f91-ad2a-4a5f-8604-0f6382baff59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cf31d39f804a4686b5d1d5c7e1cdef, user_id=22c51581bff645b9a86bb2cb65b9b5bc, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:02.952486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7f91-ad2a-4a5f-8604-0f6382baff59 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:02.969599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d81a25-858d-45a8-bd92-dabab7da4667 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:02.983671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 899/1777] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:02 2022] PUT /identity/v3/projects/98cf31d39f804a4686b5d1d5c7e1cdef/users/22c51581bff645b9a86bb2cb65b9b5bc/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:02.986294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:02.988254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:02.988611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.037774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:03.039135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.058577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.061448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.061903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.064349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.065331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:03.065823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.081287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.113596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 879/1778] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:03.115342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.117195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.129656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 900/1779] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:03.131360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.133014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.145266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55033edb-127f-4d4e-a966-08f05f438b56 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.145905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fec10b-67cc-4d5a-a66f-94429196d79a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.153190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.154017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.154297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.154569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.155530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.157372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.167620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.168507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.168953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.169231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] PATH_INFO: `/v3/projects/219ad44c49f1463a8b8007bf1601f76c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.171649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219ad44c49f1463a8b8007bf1601f76c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.176808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 901/1780] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:03.178486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.181212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.192794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eb62c-515d-438a-b7e4-8bf7fa873dbf admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.198379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116465-7b4a-4a8b-a420-28797ffe527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.200475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116465-7b4a-4a8b-a420-28797ffe527b admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.201586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116465-7b4a-4a8b-a420-28797ffe527b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.203351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116465-7b4a-4a8b-a420-28797ffe527b admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.204238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df116465-7b4a-4a8b-a420-28797ffe527b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.210342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df116465-7b4a-4a8b-a420-28797ffe527b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.279142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219ad44c49f1463a8b8007bf1601f76c', 'request_id': 'req-bbaef910-649b-4922-b1f6-ffcd05888915'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:03.291287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 902/1781] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:03.291522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219ad44c49f1463a8b8007bf1601f76c', 'request_id': 'req-bbaef910-649b-4922-b1f6-ffcd05888915'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:03.292445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.292855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.293165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.307042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219ad44c49f1463a8b8007bf1601f76c', 'request_id': 'req-bbaef910-649b-4922-b1f6-ffcd05888915'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:03.315173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] The token cache is being invalidate because project 219ad44c49f1463a8b8007bf1601f76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:03.315554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:03.315665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:03.316961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.317503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:03.321199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 880/1782] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:03 2022] DELETE /identity/v3/projects/219ad44c49f1463a8b8007bf1601f76c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:03.322981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.325912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.414387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 903/1783] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:03.415348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.416634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.432570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da46bf-f66c-4f9a-8a6b-8dbd9f16e11c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.438197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c43f6-717a-4161-807f-d39a641187b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.439595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c43f6-717a-4161-807f-d39a641187b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.439595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c43f6-717a-4161-807f-d39a641187b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.439799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c43f6-717a-4161-807f-d39a641187b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.441137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c43f6-717a-4161-807f-d39a641187b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.443687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c43f6-717a-4161-807f-d39a641187b9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.481110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 904/1784] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:03.488640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.488927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.489144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaef910-649b-4922-b1f6-ffcd05888915 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.489237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.506888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.507808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.520852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.521141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] PATH_INFO: `/v3/projects/98cf31d39f804a4686b5d1d5c7e1cdef/users/22c51581bff645b9a86bb2cb65b9b5bc/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.523444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cf31d39f804a4686b5d1d5c7e1cdef, user_id=22c51581bff645b9a86bb2cb65b9b5bc, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.527197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.541421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:03.542802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.588909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 881/1785] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:03 2022] PUT /identity/v3/projects/98cf31d39f804a4686b5d1d5c7e1cdef/users/22c51581bff645b9a86bb2cb65b9b5bc/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:03.594337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.702676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 905/1786] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:03.704410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.718500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7eff2-d70b-4aac-a575-4cb311101eed None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.734332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7b005-fbd2-4b5e-b8ef-efc9736e90c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.735089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7b005-fbd2-4b5e-b8ef-efc9736e90c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.735347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7b005-fbd2-4b5e-b8ef-efc9736e90c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.735631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7b005-fbd2-4b5e-b8ef-efc9736e90c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.736379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7b005-fbd2-4b5e-b8ef-efc9736e90c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.738105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7b005-fbd2-4b5e-b8ef-efc9736e90c5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.757055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c6806-c78e-43d9-9d53-8b9c68d64bff admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.768686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 906/1787] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:03.771360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.771918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.772451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.772967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.774465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.774732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.775002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.775735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:03.776036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.788063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d05a6-97c1-48c1-9630-abb4f5d60270 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.813621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 882/1788] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:03.815369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.815945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.815945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.818976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] MFA Rules not processed for user `22c51581bff645b9a86bb2cb65b9b5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:03.820387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.855122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:03.856514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:03.869986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 883/1789] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:03.871105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.935365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f636a-bd25-4c64-b388-78c46a379fb0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.941168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:03.943305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:03.943672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:03.944222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:03.945570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:03.946891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 907/1790] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:03.947784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:03.959152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:03.995351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 884/1791] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:03.995944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01b8f7-6a3f-4f93-bc41-3970228eea50 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:03.996102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.001477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.009034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4a45-7695-4907-865c-558d5ab822b1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.014073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.014205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.014728 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.014965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.015244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.015521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.016858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:04.017169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.017480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.018422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.018884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.021677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.038035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 885/1792] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:04.038925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.042419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:04.078952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 908/1793] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:03 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:04.079927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.170801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09322fed-d9f5-4577-a5d4-b7c7eaee803f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.177550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e4e49-7cff-4daa-a92e-b43d28bdec6e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.183088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.184022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.184299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.184661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] PATH_INFO: `/v3/projects/b2427b69d34648ee974a7b0aa8707a50/users/7e2bd7ae86554f258f0aa9e716a4c9c3/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.201443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2427b69d34648ee974a7b0aa8707a50, user_id=7e2bd7ae86554f258f0aa9e716a4c9c3, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.204693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.233822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 909/1794] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:04 2022] PUT /identity/v3/projects/b2427b69d34648ee974a7b0aa8707a50/users/7e2bd7ae86554f258f0aa9e716a4c9c3/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:04.236014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.253980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.254802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.255114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.255451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.322878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75eb647-a7a2-4446-b144-144152a47873 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.328425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5d0bc-ac2b-4241-a8db-ae7d09db0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.329089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d0bc-ac2b-4241-a8db-ae7d09db0a96 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.329368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d0bc-ac2b-4241-a8db-ae7d09db0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.329641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d0bc-ac2b-4241-a8db-ae7d09db0a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.330378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5d0bc-ac2b-4241-a8db-ae7d09db0a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.332307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5d0bc-ac2b-4241-a8db-ae7d09db0a96 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.342602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.344703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.357236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 886/1795] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:04.358191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.372054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3ab81-fd25-4b57-9bfb-d315d00e4159 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.388915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.389535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.389839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.390117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.390819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.391547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 910/1796] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:04 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:04.392784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.393286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.393520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.393841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.452114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] MFA Rules not processed for user `7e2bd7ae86554f258f0aa9e716a4c9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:04.453347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:04.463040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 887/1797] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:04 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:04.464288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.491356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d6ed-21da-4d8e-8269-337ad55b8e7e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.616644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.617384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.617674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.618027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.621730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 911/1798] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:04.622013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.622013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.625776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.654883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 888/1799] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:04 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:04.655799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.663296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dea5d-a624-4d8a-95e7-d4308425b41f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.690033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.690920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.691248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.691523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.692259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.694586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.703903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa0f4e-27fd-4c6e-a1af-dc1e5dc9ec43 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.716670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 912/1800] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:04.718071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.719970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.720655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.720940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.721220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.721975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.724499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.733206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5611-cbb5-4b77-b40f-25a50903f529 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.739523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.740873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.741204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.741482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.742556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.744201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.773774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 913/1801] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:04.774226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.802417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887137c-9127-438a-a3fe-11cb78bd33d1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.806675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 889/1802] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:04 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:04.807643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.833053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.834045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.834793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.838095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.840264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.846930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.896659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 914/1803] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:04.899349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.914543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5576f8-2244-4472-b39b-4b63f2e93976 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.920161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb203e-9dea-461c-bd2b-63645f5bf227 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.923785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.924782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.925219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.925644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.926517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.929269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.941806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.944921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.945227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.945539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.946344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:04.952383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:04.960665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 915/1804] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:04 2022] POST /identity/v3/users => generated 293 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:04.961566 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.972672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f456-9f56-40f6-a2cb-f00a1acf3906 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:04.982721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 890/1805] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:04.982721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:04.982978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:04.983245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:04.983623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:04.983991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] PATH_INFO: `/v3/projects/630874e3ff97448ea96f1d0d62f1a905/users/40ddaf77e7b745439a95553404fb209b/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:04.997385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208b78-9406-4b40-a851-22ba3001c751 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.002412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.004007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.004281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.004850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.006306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.009452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.020051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 891/1806] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:05.021859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.026047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630874e3ff97448ea96f1d0d62f1a905, user_id=40ddaf77e7b745439a95553404fb209b, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.028972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.034742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337de9-e345-4079-93a7-ebe301a2ac54 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.041307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4c298-d21e-4291-9a12-a3d2410bc6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.042597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4c298-d21e-4291-9a12-a3d2410bc6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.042871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4c298-d21e-4291-9a12-a3d2410bc6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.043459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4c298-d21e-4291-9a12-a3d2410bc6a7 admin admin] PATH_INFO: `/v3/projects/38fd78b939a042f7981b9e97c85ac4d7/users/3a8c64a77de547b59c568317b2fbcaa7/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.055415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 916/1807] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:04 2022] PUT /identity/v3/projects/630874e3ff97448ea96f1d0d62f1a905/users/40ddaf77e7b745439a95553404fb209b/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:05.056141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.115524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4c298-d21e-4291-9a12-a3d2410bc6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fd78b939a042f7981b9e97c85ac4d7, user_id=3a8c64a77de547b59c568317b2fbcaa7, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.118341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4c298-d21e-4291-9a12-a3d2410bc6a7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.143044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 892/1808] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:05 2022] PUT /identity/v3/projects/38fd78b939a042f7981b9e97c85ac4d7/users/3a8c64a77de547b59c568317b2fbcaa7/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:05.144413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038361aa-7911-462c-9600-b127855924bd None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.144701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038361aa-7911-462c-9600-b127855924bd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.144975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038361aa-7911-462c-9600-b127855924bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.183884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609446-4637-4bf3-8a9b-bacf708dac78 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.235529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-038361aa-7911-462c-9600-b127855924bd None None] MFA Rules not processed for user `40ddaf77e7b745439a95553404fb209b`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:05.236093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-038361aa-7911-462c-9600-b127855924bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:05.310053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16b43-b7a4-4d3b-98df-446da6b5585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.311763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16b43-b7a4-4d3b-98df-446da6b5585f admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.311763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16b43-b7a4-4d3b-98df-446da6b5585f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.312000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16b43-b7a4-4d3b-98df-446da6b5585f admin admin] PATH_INFO: `/v3/projects/972fefb041a74d5f9d6c2ad97fb9fe2a/users/5fbde9ac2a3642328977b63af1b87dfb/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.336329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16b43-b7a4-4d3b-98df-446da6b5585f admin admin] RBAC: Authorizing `identity:create_grant(project_id=972fefb041a74d5f9d6c2ad97fb9fe2a, user_id=5fbde9ac2a3642328977b63af1b87dfb, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.343966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16b43-b7a4-4d3b-98df-446da6b5585f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.369792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 917/1809] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:05 2022] PUT /identity/v3/projects/972fefb041a74d5f9d6c2ad97fb9fe2a/users/5fbde9ac2a3642328977b63af1b87dfb/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:05.371534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.373958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.373958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.382264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 893/1810] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:05.383669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038361aa-7911-462c-9600-b127855924bd None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.397327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038361aa-7911-462c-9600-b127855924bd None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.428910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] MFA Rules not processed for user `3a8c64a77de547b59c568317b2fbcaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:05.430192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:05.515983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.516810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.516962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.517226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.518003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.520341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.537719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 918/1811] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:05.537719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.537991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 894/1812] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:05.542538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.555387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c875706-a634-4535-80af-c09b879fb7f1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.558652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bf8c9-a412-40b9-b5a4-e20e12578ed2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.561512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.562367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.562647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.562954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.563748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.563878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.564549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.564861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.565108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.565901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.567322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.572477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.609383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 895/1813] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:05.615343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.615528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 919/1814] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:05.615528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.688793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1001f-7c41-4846-8871-d8f1c7a5b6cb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.701902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.705865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.708100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.708671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.711445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.715023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.764355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a39678-afa3-4194-9f64-0822f69489ef admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.767792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 920/1815] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:05.768745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.771973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.773167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.773530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.774134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] PATH_INFO: `/v3/projects/972fefb041a74d5f9d6c2ad97fb9fe2a/users/5fbde9ac2a3642328977b63af1b87dfb/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.777222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=972fefb041a74d5f9d6c2ad97fb9fe2a, user_id=5fbde9ac2a3642328977b63af1b87dfb, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.780251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.791559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6b52-39b2-4cec-9a39-e60b39dd8f70 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.795272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 896/1816] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:05 2022] PUT /identity/v3/projects/972fefb041a74d5f9d6c2ad97fb9fe2a/users/5fbde9ac2a3642328977b63af1b87dfb/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:05.796354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:05.905266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342aaaca-3fa8-4529-8214-cf20730354f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.905927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aaaca-3fa8-4529-8214-cf20730354f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.906216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aaaca-3fa8-4529-8214-cf20730354f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.907896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aaaca-3fa8-4529-8214-cf20730354f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.908624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aaaca-3fa8-4529-8214-cf20730354f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.912485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aaaca-3fa8-4529-8214-cf20730354f1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.930843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e26912-7a0c-49f0-8d9c-23607d2a48ec admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:05.944393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:05.945086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.945365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.945641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.952793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:05.954500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:05.961338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 921/1817] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:05.962989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:05.963282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:05.963761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:05.982506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 897/1818] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:05.982506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.012893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e7187-ddf4-426f-b7dc-ccb7d255dd12 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.022245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.023752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.024231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.024876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.025850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.029990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.043392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 898/1819] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:06.044962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.059237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] MFA Rules not processed for user `5fbde9ac2a3642328977b63af1b87dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:06.061075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:06.078247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68852f6c-5060-417c-8c26-e150eec684b5 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.099576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.104148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.104665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.105170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] PATH_INFO: `/v3/projects/2a43ecdbf96b43298d58c549f9053d2a/users/0a349154f4a64d7690031149ed81abc5/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.176181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a43ecdbf96b43298d58c549f9053d2a, user_id=0a349154f4a64d7690031149ed81abc5, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.180432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.209150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 899/1820] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:06 2022] PUT /identity/v3/projects/2a43ecdbf96b43298d58c549f9053d2a/users/0a349154f4a64d7690031149ed81abc5/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:06.210132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.234256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 922/1821] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:06.234927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.256831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb2913-fef5-49e0-b78c-9e4bc1c2d4df None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.280595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351201-96c1-4335-974d-bf9ad64fe7f4 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.285434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.287658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.287938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.288914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] PATH_INFO: `/v3/projects/88106e6be57c44d6952ff55d86fd70f3/users/349bc9d4c89146668e74f0740de8410d/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.335129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88106e6be57c44d6952ff55d86fd70f3, user_id=349bc9d4c89146668e74f0740de8410d, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.340931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.367913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 900/1822] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:06 2022] PUT /identity/v3/projects/88106e6be57c44d6952ff55d86fd70f3/users/349bc9d4c89146668e74f0740de8410d/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:06.371043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.386658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.387343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.387622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.387895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.388631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.390748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.407060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 923/1823] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:06.407821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.425534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf5e07-39a4-47bd-9772-369bc877d069 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.493612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb8907-f550-472c-8311-689dd2fb0a07 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.500164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2ec2a-c930-43a8-9044-916470798b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.503668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ec2a-c930-43a8-9044-916470798b65 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.503923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ec2a-c930-43a8-9044-916470798b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.504206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2ec2a-c930-43a8-9044-916470798b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.518348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.520047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.520332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.520789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.521711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.523975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.538367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 924/1824] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:06.539288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.559846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04631-1321-4431-a8da-fdf233978968 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.573399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.574634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.574912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.575184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] PATH_INFO: `/v3/projects/2a43ecdbf96b43298d58c549f9053d2a/users/0a349154f4a64d7690031149ed81abc5/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.578856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a43ecdbf96b43298d58c549f9053d2a, user_id=0a349154f4a64d7690031149ed81abc5, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.583023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.608743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 925/1825] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:06 2022] PUT /identity/v3/projects/2a43ecdbf96b43298d58c549f9053d2a/users/0a349154f4a64d7690031149ed81abc5/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:06.609804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.632107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ec2a-c930-43a8-9044-916470798b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.633975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2ec2a-c930-43a8-9044-916470798b65 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.670220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 901/1826] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:06.689682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66963f0d-be6e-4f3a-8c5a-d8b363ae2ee7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.694136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66963f0d-be6e-4f3a-8c5a-d8b363ae2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.694448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66963f0d-be6e-4f3a-8c5a-d8b363ae2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.757772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba77a3-3396-4a5f-ba46-d3886a15763d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.758492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-66963f0d-be6e-4f3a-8c5a-d8b363ae2ee7 None None] MFA Rules not processed for user `0a349154f4a64d7690031149ed81abc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:06.759759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-66963f0d-be6e-4f3a-8c5a-d8b363ae2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:06.765316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.766869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.785487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.786034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] PATH_INFO: `/v3/projects/88106e6be57c44d6952ff55d86fd70f3/users/349bc9d4c89146668e74f0740de8410d/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.789003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88106e6be57c44d6952ff55d86fd70f3, user_id=349bc9d4c89146668e74f0740de8410d, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.795218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.808914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 926/1827] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:06 2022] PUT /identity/v3/projects/88106e6be57c44d6952ff55d86fd70f3/users/349bc9d4c89146668e74f0740de8410d/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:06.810060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:06.937209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 902/1828] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:06.937209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.937209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.937209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.950484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b8468-22a3-47e1-ad4c-411a56d93181 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:06.956252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:06.957459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:06.959721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:06.960199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] PATH_INFO: `/v3/users/a3a6487be58c42f59906034f8f7dee54` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:06.961898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a6487be58c42f59906034f8f7dee54)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:06.965084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:06.975843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] MFA Rules not processed for user `349bc9d4c89146668e74f0740de8410d`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:06.977508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.047540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a6487be58c42f59906034f8f7dee54'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:07.065943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a6487be58c42f59906034f8f7dee54'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:07.082286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a6487be58c42f59906034f8f7dee54'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:07.088433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 903/1829] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:07.095044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:07.097141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.103774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a6487be58c42f59906034f8f7dee54'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:07.104509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b65a42c1-e162-447a-9c3d-707190ad2816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a6487be58c42f59906034f8f7dee54'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:07.118931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 927/1830] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:06 2022] DELETE /identity/v3/users/a3a6487be58c42f59906034f8f7dee54 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:07.121994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142ad2-174a-4dea-9b2f-6fbab629fb6d None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.121994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142ad2-174a-4dea-9b2f-6fbab629fb6d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.121994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28142ad2-174a-4dea-9b2f-6fbab629fb6d None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.122325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 928/1831] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:57:07.123441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.123721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.123994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.153495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:07.154767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.192759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0c0fe-1382-4f0a-98f2-aaad2ab0da8c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:07.228208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 929/1832] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:07.229167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:07.232985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.247456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:07.248114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.248421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.248740 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.250672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.302321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5431f5-1937-422a-aed5-c4447c7c924e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:07.307004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:07.308232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.308660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.309106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.311173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.325193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:07.326897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3e96a-9bb4-4c54-bd1a-31e46f2dc7f5 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:07.343068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 904/1833] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:07.346259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.349637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.349905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.383395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:07.384977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.421113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:07.422837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:07.455936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 930/1834] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:07.457285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:07.459083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.497577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 905/1835] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:07.513173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:07.519242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.541247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7be86-ae59-48b1-97a5-d1dfa9f045a5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:07.548439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:07.549153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.549432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.549698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.560861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:07.562579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:07.563532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de923e28-79c5-4802-a58a-b9fe1f1841c3 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:07.571804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:07.572175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.572526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.572800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.590493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 906/1836] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:07.590734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:07.591333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:07.592109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:07.592795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.606411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3266759-b6b2-4464-a41c-e13dd40a6bab service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:07.610829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:07.612343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 931/1837] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:07.613627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:07.622150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.625578 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293daf58-5b11-4868-8451-0e503ed83705 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:07.627078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.627495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.630783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:07.631502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:07.632062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:07.632402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:07.635306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.636096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:07.768874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:07.771455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:07.807886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 907/1838] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:07.839236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:07.840697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5a6e0-5aa1-4f4a-b37e-c0357c61f628 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:07.866214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 932/1839] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:08.303605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:08.306293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:08.343258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3eb73-d87a-498f-98e4-2ce53ea5f055 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:08.368859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:08.370100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:08.370425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:08.370701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] PATH_INFO: `/v3/users/7e2bd7ae86554f258f0aa9e716a4c9c3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:08.373560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2bd7ae86554f258f0aa9e716a4c9c3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:08.376072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:08.498007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2bd7ae86554f258f0aa9e716a4c9c3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:08.516604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2bd7ae86554f258f0aa9e716a4c9c3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:08.532402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2bd7ae86554f258f0aa9e716a4c9c3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:08.534295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2bd7ae86554f258f0aa9e716a4c9c3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:08.563553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e31bb4-6f69-41b9-a211-337ff9e3ae8a None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:08.564498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e31bb4-6f69-41b9-a211-337ff9e3ae8a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:08.564918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e31bb4-6f69-41b9-a211-337ff9e3ae8a None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:08.566967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 933/1840] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:57:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:57:08.573052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4f6078c0-7124-48bb-8e2b-49e709dd3d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2bd7ae86554f258f0aa9e716a4c9c3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:08.588688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 908/1841] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:08 2022] DELETE /identity/v3/users/7e2bd7ae86554f258f0aa9e716a4c9c3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:08.593090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:08.593615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:08.594055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:08.622423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:08.624301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:08.626731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:08.627270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:08.627685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:08.667695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:08.671003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:08.785172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 934/1842] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:08.813721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:08.815216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:08.862162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 909/1843] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:08.919784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242189d-52a3-443b-9a46-c5747c195974 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:08.923178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:08.923848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:08.924107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:08.924381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:08.938157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:08.939623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:08.952401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 935/1844] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:08.971370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:08.973102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:08.994173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad220-f8cd-471c-91b5-f64987763f26 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:09.003626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:09.004395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:09.004708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:09.005561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:09.028943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:09.037428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:09.057853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:09.059487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:09.067231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 910/1845] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:09.102662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5ebc-1387-41b4-b6a3-fcf5461b915c service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:09.108224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:09.109562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:09.109873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:09.110154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] PATH_INFO: `/v3/projects/72e65bd4fb3d4707af3480f94912a0bd` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:09.114570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e65bd4fb3d4707af3480f94912a0bd)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:09.124048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:09.202557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e65bd4fb3d4707af3480f94912a0bd', 'request_id': 'req-271abbef-62cb-4722-9d6e-38309328f731'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.216839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e65bd4fb3d4707af3480f94912a0bd', 'request_id': 'req-271abbef-62cb-4722-9d6e-38309328f731'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.225156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e65bd4fb3d4707af3480f94912a0bd', 'request_id': 'req-271abbef-62cb-4722-9d6e-38309328f731'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.238518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] The token cache is being invalidate because project 72e65bd4fb3d4707af3480f94912a0bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:09.238903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.239674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.241826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 936/1846] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:09 2022] DELETE /identity/v3/projects/72e65bd4fb3d4707af3480f94912a0bd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:09.245436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:09.257654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68319f-7a7d-4aa7-b8dd-b02490bf3aee service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:09.334999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:09.335880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:09.336211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:09.336488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] PATH_INFO: `/v3/users/22c51581bff645b9a86bb2cb65b9b5bc` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:09.337692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c51581bff645b9a86bb2cb65b9b5bc)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:09.339680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:09.421252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c51581bff645b9a86bb2cb65b9b5bc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.423695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:09.426091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:09.435973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c51581bff645b9a86bb2cb65b9b5bc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.450289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c51581bff645b9a86bb2cb65b9b5bc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.452265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271abbef-62cb-4722-9d6e-38309328f731 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:09.454327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c51581bff645b9a86bb2cb65b9b5bc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.461244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:09.462338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:09.462434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:09.462699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] PATH_INFO: `/v3/projects/b2427b69d34648ee974a7b0aa8707a50` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:09.465668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2427b69d34648ee974a7b0aa8707a50)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:09.467616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:09.475449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c51581bff645b9a86bb2cb65b9b5bc'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.484951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 911/1847] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:09 2022] DELETE /identity/v3/users/22c51581bff645b9a86bb2cb65b9b5bc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:09.670571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2427b69d34648ee974a7b0aa8707a50', 'request_id': 'req-0e51b540-928f-42ec-9e5d-bc25d707f645'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.705706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2427b69d34648ee974a7b0aa8707a50', 'request_id': 'req-0e51b540-928f-42ec-9e5d-bc25d707f645'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.728675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2427b69d34648ee974a7b0aa8707a50', 'request_id': 'req-0e51b540-928f-42ec-9e5d-bc25d707f645'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.765371 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] The token cache is being invalidate because project b2427b69d34648ee974a7b0aa8707a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:09.768791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.773072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:09.775771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 937/1848] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:09 2022] DELETE /identity/v3/projects/b2427b69d34648ee974a7b0aa8707a50 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:09.779758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:09.781360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:09.861492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793fae5-3736-4ada-af06-0a847b6ff911 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:09.967398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:09.968289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:09.968564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:09.968843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] PATH_INFO: `/v3/users/5fbde9ac2a3642328977b63af1b87dfb` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:09.970494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbde9ac2a3642328977b63af1b87dfb)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:09.975672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.081586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbde9ac2a3642328977b63af1b87dfb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.092709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbde9ac2a3642328977b63af1b87dfb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.104406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbde9ac2a3642328977b63af1b87dfb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.105434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbde9ac2a3642328977b63af1b87dfb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.125489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dddc1ee7-5341-4910-9577-3a7049cc07a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbde9ac2a3642328977b63af1b87dfb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.136630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 912/1849] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:09 2022] DELETE /identity/v3/users/5fbde9ac2a3642328977b63af1b87dfb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:10.223273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.225273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.238393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b540-928f-42ec-9e5d-bc25d707f645 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.332442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.333556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.335561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.335853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] PATH_INFO: `/v3/projects/98cf31d39f804a4686b5d1d5c7e1cdef` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.337684 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cf31d39f804a4686b5d1d5c7e1cdef)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.340707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.393692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cf31d39f804a4686b5d1d5c7e1cdef', 'request_id': 'req-2666f726-b8bf-4560-a9d0-b4a50743d344'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.410419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cf31d39f804a4686b5d1d5c7e1cdef', 'request_id': 'req-2666f726-b8bf-4560-a9d0-b4a50743d344'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.423594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cf31d39f804a4686b5d1d5c7e1cdef', 'request_id': 'req-2666f726-b8bf-4560-a9d0-b4a50743d344'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.446419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] The token cache is being invalidate because project 98cf31d39f804a4686b5d1d5c7e1cdef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:10.446983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.447842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-2666f726-b8bf-4560-a9d0-b4a50743d344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.450790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 938/1850] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:10 2022] DELETE /identity/v3/projects/98cf31d39f804a4686b5d1d5c7e1cdef => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:10.455626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.456190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.456671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.478828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:10.480261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.554842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 913/1851] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:10.562598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.562909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.563231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.588631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:10.590401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.601667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 939/1852] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:10.608494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.608748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.616698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.621331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed4b76-7191-4d73-bdc2-cb26972a39f4 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.626816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.627486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.627759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.628053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.628805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:10.629108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.630773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.634976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5052c33-0576-4735-81e1-d753fc4eaa7e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.642977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.644168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.644624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.645041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] PATH_INFO: `/v3/projects/972fefb041a74d5f9d6c2ad97fb9fe2a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.647288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972fefb041a74d5f9d6c2ad97fb9fe2a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.651062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.655654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 940/1853] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:10.659600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.674468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7784c0d-0c05-4bdc-b172-9237e8342612 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.681919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.682595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.682875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.683147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.683856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.685806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.723349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 941/1854] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:10.728605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972fefb041a74d5f9d6c2ad97fb9fe2a', 'request_id': 'req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.729351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.738156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972fefb041a74d5f9d6c2ad97fb9fe2a', 'request_id': 'req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.744952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972fefb041a74d5f9d6c2ad97fb9fe2a', 'request_id': 'req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.756635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] The token cache is being invalidate because project 972fefb041a74d5f9d6c2ad97fb9fe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:10.757095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.757511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0fa938e-6f2b-439f-9fe1-7ab533a6b178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:10.759091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 914/1855] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:10 2022] DELETE /identity/v3/projects/972fefb041a74d5f9d6c2ad97fb9fe2a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:10.763724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd86b30-f150-40f6-9e27-fcea6b8178aa None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.764020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd86b30-f150-40f6-9e27-fcea6b8178aa None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.764295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd86b30-f150-40f6-9e27-fcea6b8178aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.785195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9bd86b30-f150-40f6-9e27-fcea6b8178aa None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:10.787704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9bd86b30-f150-40f6-9e27-fcea6b8178aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.796151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 915/1856] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:10.797012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a201479-39ef-4264-8d46-c0ee0b114610 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.802197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.802875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.803087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.803357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.804032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.804175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.804463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.804743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.805993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.827176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:10.828602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.832286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 942/1857] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:10.833696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.835711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.843106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 916/1858] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:10.844011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.848928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22f7e0-b6ce-4b3e-bf3c-49482942328e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.853291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9b95-0d4d-493b-8040-d615b8320af0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.859086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.859756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.860060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.860284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.861054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:10.861214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.861361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.862582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.862863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.863166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.863474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.865616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.868085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.876192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 917/1859] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:10.880465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 943/1860] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:10.881017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.883898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.893334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e854ed-7a07-4be5-af06-6312872fc69d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.895357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313ece-44a2-4e21-9aac-be6b4d935873 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.901902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.902044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876046e1-66de-445a-8658-3618a458920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.902706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876046e1-66de-445a-8658-3618a458920e admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.902814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.902982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876046e1-66de-445a-8658-3618a458920e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.903140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.903238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.903656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876046e1-66de-445a-8658-3618a458920e admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.903938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.904390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876046e1-66de-445a-8658-3618a458920e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.906055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.906172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876046e1-66de-445a-8658-3618a458920e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.916405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 944/1861] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:10.920522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876046e1-66de-445a-8658-3618a458920e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.931787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876046e1-66de-445a-8658-3618a458920e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:10.941305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:10.942247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:10.943063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:10.943335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] PATH_INFO: `/v3/projects/ae709cf115cb4cb28cfb9e36ca79a063/users/924f96040dfe4118a5a9e8931c870767/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:10.949093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 918/1862] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:10.949093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:10.951325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:10.967408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae709cf115cb4cb28cfb9e36ca79a063, user_id=924f96040dfe4118a5a9e8931c870767, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:10.970773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:10.992064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 945/1863] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:10 2022] PUT /identity/v3/projects/ae709cf115cb4cb28cfb9e36ca79a063/users/924f96040dfe4118a5a9e8931c870767/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:10.993028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.033111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e863f-3fac-4e24-84d4-7006bcedaafb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.080352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a33847-7acc-499d-833b-e8c58f5db49b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.086760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5761f-a156-4f72-8b31-c0244a0951b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.087851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5761f-a156-4f72-8b31-c0244a0951b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.088126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5761f-a156-4f72-8b31-c0244a0951b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.088402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5761f-a156-4f72-8b31-c0244a0951b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.089163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5761f-a156-4f72-8b31-c0244a0951b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.092877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5761f-a156-4f72-8b31-c0244a0951b8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.119154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 946/1864] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:10 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:11.120508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.120792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.121066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.163796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] MFA Rules not processed for user `924f96040dfe4118a5a9e8931c870767`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:11.166224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:11.205203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.206189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.206463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.206731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] PATH_INFO: `/v3/users/40ddaf77e7b745439a95553404fb209b` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.208592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ddaf77e7b745439a95553404fb209b)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.210711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.283802 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ddaf77e7b745439a95553404fb209b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:11.290890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ddaf77e7b745439a95553404fb209b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:11.298213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ddaf77e7b745439a95553404fb209b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:11.298846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ddaf77e7b745439a95553404fb209b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:11.302832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 947/1865] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:11.303998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.314450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ddaf77e7b745439a95553404fb209b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:11.322752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29630e-15a0-4599-87fc-66351b3e5e04 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.331594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 919/1866] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:10 2022] DELETE /identity/v3/users/40ddaf77e7b745439a95553404fb209b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:11.332541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.334559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:11.413059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8b5b8-c37a-4a9e-8743-dd51613e0c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.414009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b5b8-c37a-4a9e-8743-dd51613e0c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.414483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b5b8-c37a-4a9e-8743-dd51613e0c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.414953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b5b8-c37a-4a9e-8743-dd51613e0c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.415912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8b5b8-c37a-4a9e-8743-dd51613e0c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.417614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8b5b8-c37a-4a9e-8743-dd51613e0c2f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.417852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab567-ebdc-4472-bf67-bff72fb02f2f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.426434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.428064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.428637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.429103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.430115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.432392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.438757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 948/1867] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:11.440101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.440393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.440668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.471410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:11.472824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:11.473511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 920/1868] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:11.481614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.487237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:11.585904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205004b5-e887-4ef3-8119-a896cab70229 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.593260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.593386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 949/1869] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:11.594397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.594640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.595108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.595545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.596636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.599425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.607551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b40dc0-70d9-4229-b627-2cd973d6d371 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.612589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.613264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.613544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.613857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.614921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.619222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 921/1870] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:11.619380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.619466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.623528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:11.649474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 950/1871] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/users => generated 302 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:11.650181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.662719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660fe01-dec0-498a-8a13-8c0448a75e2d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.668757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.670221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.670504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.670780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] PATH_INFO: `/v3/projects/57794cd036cf4c3fb80f2114caed1c6f/users/362a913efc5b49a88401085e6fda9ae7/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.688771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57794cd036cf4c3fb80f2114caed1c6f, user_id=362a913efc5b49a88401085e6fda9ae7, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.691880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.695713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7029261-bdc1-4172-ac11-d810e0a29cc8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.709226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3478476-0836-4ab3-8300-82c1257f64d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.709952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 951/1872] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:11 2022] PUT /identity/v3/projects/57794cd036cf4c3fb80f2114caed1c6f/users/362a913efc5b49a88401085e6fda9ae7/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:11.710794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.716742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478476-0836-4ab3-8300-82c1257f64d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.717206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478476-0836-4ab3-8300-82c1257f64d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.717464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478476-0836-4ab3-8300-82c1257f64d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.731377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3478476-0836-4ab3-8300-82c1257f64d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.733022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3478476-0836-4ab3-8300-82c1257f64d6 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.744085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 922/1873] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:11.745545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.745966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.746811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.776644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] MFA Rules not processed for user `362a913efc5b49a88401085e6fda9ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:11.778344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:11.794138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd3b0-b497-42cd-9b8f-63c93a6cbf58 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.800656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.801601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.802799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.803473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.804395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.806219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.816717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 952/1874] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:11.822290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.839635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d4b1-e509-41a5-afd8-703522f03666 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.845664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.846853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.847369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.847740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] PATH_INFO: `/v3/projects/99d6b0a11def44ac90320e7915925497/users/08e0e24633f54e3c809528e28579ff42/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.866151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 923/1875] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:11.868568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d6b0a11def44ac90320e7915925497, user_id=08e0e24633f54e3c809528e28579ff42, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.870913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.872809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.885033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ae0ff-d85a-4a5e-a016-1cd9371f0b27 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:11.891724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:11.892597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:11.893024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:11.893471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:11.894358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:11.896476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:11.898101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 953/1876] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:11 2022] PUT /identity/v3/projects/99d6b0a11def44ac90320e7915925497/users/08e0e24633f54e3c809528e28579ff42/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:11.902142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:11.934430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 924/1877] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:11.947045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.088422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affd69f-90f9-45a1-a222-265cab9903ae admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.122684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c69cd-eee7-4f86-9e77-b9343e1e0c11 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.135665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.136091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.136391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.137043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.137757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.142688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.185112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 925/1878] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:11 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:12.191214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.212546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc96e-c30c-437a-a59e-0c87c6e5abae admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.220548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.221981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.222427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.222936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.224142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.226456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.241689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.242212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.242871 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 954/1879] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:12.243264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.244227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.245321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.247518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.249415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.255859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e04fc-8359-4430-a1ec-34ec0bfda29d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.260895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795250-e8b1-41f2-805f-987c99143876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.262086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795250-e8b1-41f2-805f-987c99143876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.262528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795250-e8b1-41f2-805f-987c99143876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.263385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795250-e8b1-41f2-805f-987c99143876 admin admin] PATH_INFO: `/v3/projects/99d6b0a11def44ac90320e7915925497/users/08e0e24633f54e3c809528e28579ff42/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.265716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795250-e8b1-41f2-805f-987c99143876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d6b0a11def44ac90320e7915925497, user_id=08e0e24633f54e3c809528e28579ff42, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.268606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795250-e8b1-41f2-805f-987c99143876 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.295676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 926/1881] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:12.296600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 955/1881] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:12 2022] PUT /identity/v3/projects/99d6b0a11def44ac90320e7915925497/users/08e0e24633f54e3c809528e28579ff42/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:12.297886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.298463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.298891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.299317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.340502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aee96-5aa2-4ee5-b00b-88e574ef899c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.341191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] MFA Rules not processed for user `08e0e24633f54e3c809528e28579ff42`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:12.343654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.486779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.487354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.487632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.488352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] PATH_INFO: `/v3/projects/b5a1e7033f924fa4a44c2d93fdf1735e/users/a8534c727efb4f31989e0aae743d7a5f/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.499501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 956/1882] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:12.500539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.502153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.509630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a1e7033f924fa4a44c2d93fdf1735e, user_id=a8534c727efb4f31989e0aae743d7a5f, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.513293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.519054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc0268-4c0d-4364-a6f7-6dc5e2f73a85 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.527264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.528512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.528889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.529169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] PATH_INFO: `/v3/projects/630874e3ff97448ea96f1d0d62f1a905` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.530423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=630874e3ff97448ea96f1d0d62f1a905)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.532466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.533413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 927/1883] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:12 2022] PUT /identity/v3/projects/b5a1e7033f924fa4a44c2d93fdf1735e/users/a8534c727efb4f31989e0aae743d7a5f/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:12.534518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.536954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.601814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630874e3ff97448ea96f1d0d62f1a905', 'request_id': 'req-b2121c96-1d85-4b87-ad61-c207b62812fb'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.605501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcca6b1-9745-46bd-b961-70ef59b0b624 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.616747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630874e3ff97448ea96f1d0d62f1a905', 'request_id': 'req-b2121c96-1d85-4b87-ad61-c207b62812fb'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.623837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630874e3ff97448ea96f1d0d62f1a905', 'request_id': 'req-b2121c96-1d85-4b87-ad61-c207b62812fb'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.636408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] The token cache is being invalidate because project 630874e3ff97448ea96f1d0d62f1a905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:12.636747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.637466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.639753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 957/1884] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:12 2022] DELETE /identity/v3/projects/630874e3ff97448ea96f1d0d62f1a905 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:12.640690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.643778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.683482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.684148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.685904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.686189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.689030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.739185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2121c96-1d85-4b87-ad61-c207b62812fb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.746599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.747619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.748203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.748607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.749698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.751543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.766141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 958/1885] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:12.767293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.768982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.784825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b196-0201-48e4-9f7f-bb145a48f14f admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.792510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.793560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.794111 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.794413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] PATH_INFO: `/v3/users/0a349154f4a64d7690031149ed81abc5` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.796178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a349154f4a64d7690031149ed81abc5)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.798450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.833064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.834617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.846464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 928/1886] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:12.847311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.862180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6de15-b1f4-47f6-a79b-94853acac891 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:12.869791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec5fe-ad60-466b-afa1-2da51df1d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:12.870714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec5fe-ad60-466b-afa1-2da51df1d846 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.871013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec5fe-ad60-466b-afa1-2da51df1d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.871402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec5fe-ad60-466b-afa1-2da51df1d846 admin admin] PATH_INFO: `/v3/projects/b5a1e7033f924fa4a44c2d93fdf1735e/users/a8534c727efb4f31989e0aae743d7a5f/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.873677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edec5fe-ad60-466b-afa1-2da51df1d846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a1e7033f924fa4a44c2d93fdf1735e, user_id=a8534c727efb4f31989e0aae743d7a5f, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:12.874293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a349154f4a64d7690031149ed81abc5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.877277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edec5fe-ad60-466b-afa1-2da51df1d846 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:12.891054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 929/1887] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:12 2022] PUT /identity/v3/projects/b5a1e7033f924fa4a44c2d93fdf1735e/users/a8534c727efb4f31989e0aae743d7a5f/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:12.896992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a349154f4a64d7690031149ed81abc5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.902156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:12.902430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:12.902675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:12.912467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a349154f4a64d7690031149ed81abc5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.922894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a349154f4a64d7690031149ed81abc5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.923758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a349154f4a64d7690031149ed81abc5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:12.934144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] MFA Rules not processed for user `a8534c727efb4f31989e0aae743d7a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:12.935560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:12.937503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 959/1888] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:12 2022] DELETE /identity/v3/users/0a349154f4a64d7690031149ed81abc5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:12.938822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:12.940187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.058843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d07fe-6931-42f2-a648-41735a77e5d6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.063991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.065311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.065941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.066738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.070033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.107701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 930/1889] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:13.152368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:13.154933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.166812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cd261-05f4-4670-921f-1cef66e591d5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.171499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.172294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.172578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.172848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.175148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.204938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.206864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:13.218849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 960/1890] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:13.261009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.262560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf7192-683c-4095-8217-34719cac4acb service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:13.274329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 931/1891] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:13.375734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:13.376325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.480664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d99cb8-f455-428b-8051-66c3a8b41aae service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.485681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.486657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.487003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.487342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] PATH_INFO: `/v3/projects/2a43ecdbf96b43298d58c549f9053d2a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.488737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a43ecdbf96b43298d58c549f9053d2a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.490922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:13.545464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a43ecdbf96b43298d58c549f9053d2a', 'request_id': 'req-87ba9846-61ba-4641-9efe-5e891985668f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.555749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a43ecdbf96b43298d58c549f9053d2a', 'request_id': 'req-87ba9846-61ba-4641-9efe-5e891985668f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.566827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a43ecdbf96b43298d58c549f9053d2a', 'request_id': 'req-87ba9846-61ba-4641-9efe-5e891985668f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.578127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] The token cache is being invalidate because project 2a43ecdbf96b43298d58c549f9053d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:13.578486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.579161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-87ba9846-61ba-4641-9efe-5e891985668f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.580829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 961/1892] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:13 2022] DELETE /identity/v3/projects/2a43ecdbf96b43298d58c549f9053d2a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:13.586348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.586578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.586818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.610881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:13.613019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.699325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 932/1893] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:13.707413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069896-dae2-4def-9d03-331896511564 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.708856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069896-dae2-4def-9d03-331896511564 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.709148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069896-dae2-4def-9d03-331896511564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.735434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9c069896-dae2-4def-9d03-331896511564 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:13.736940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9c069896-dae2-4def-9d03-331896511564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.746170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 962/1894] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:13.750520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:13.761033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eeef2-b868-4362-b15e-4f7736dd1a09 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.765841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.766553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.766962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.767359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.768243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:13.768531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.770437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:13.784675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 933/1895] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:13.789234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069896-dae2-4def-9d03-331896511564 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:13.794607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:13.796449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.800183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069896-dae2-4def-9d03-331896511564 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.806388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.806751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.807029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.807299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.807986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.809936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:13.810314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e507e9a-a024-4604-a8b1-b5c7f1ba6558 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.815098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.816054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.816539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.816880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] PATH_INFO: `/v3/users/3a8c64a77de547b59c568317b2fbcaa7` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.818733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8c64a77de547b59c568317b2fbcaa7)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.820880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:13.843647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 963/1896] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:13 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:13.844993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:13.872487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8c64a77de547b59c568317b2fbcaa7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.880720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8c64a77de547b59c568317b2fbcaa7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.888880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8c64a77de547b59c568317b2fbcaa7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.889573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8c64a77de547b59c568317b2fbcaa7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.902099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1a5cb5a9-0c00-45ba-b639-b5bca84dc71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8c64a77de547b59c568317b2fbcaa7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:13.908093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 934/1897] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:13 2022] DELETE /identity/v3/users/3a8c64a77de547b59c568317b2fbcaa7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:13.912718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.913006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.913277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.918230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04be6-5502-469c-be58-adaf65c222fd admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:13.944428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:13.944428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:13.981446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:13.983967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:13.984470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:13.984686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:13.985447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:13.988163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.023951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 935/1898] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:14.035858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.037417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:14.041625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 964/1899] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:13 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:14.043361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.048738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:14.064933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4d11a-d650-4023-ab07-63e31c34bd63 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.070555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.071323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.071600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.071866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.073535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.076093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.087159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 965/1900] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:14.097412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.109458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3196d-7796-411b-bae6-327eafc9fdd6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.115981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.116950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.117166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.117433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.118193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.119790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.132730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 966/1901] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:14.133462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b925a60-4ef8-4e22-8264-300f080e2819 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.133965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.137113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608d480-f3ae-4398-9cba-e9673d0eb60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.138325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d480-f3ae-4398-9cba-e9673d0eb60e service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.138325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d480-f3ae-4398-9cba-e9673d0eb60e service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.138325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608d480-f3ae-4398-9cba-e9673d0eb60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.146610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214d04a-33b7-4c9e-87db-21906edbaa37 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.147683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d480-f3ae-4398-9cba-e9673d0eb60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.149128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608d480-f3ae-4398-9cba-e9673d0eb60e service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.154478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.155106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.155389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.155708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] PATH_INFO: `/v3/projects/a5177742e24e4ed6adec745d6f16cb03/users/8a5666ae5f294fe889ce36fef5832f3a/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.159539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 936/1902] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:14.175368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5177742e24e4ed6adec745d6f16cb03, user_id=8a5666ae5f294fe889ce36fef5832f3a, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.179043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.194191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 967/1903] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:14 2022] PUT /identity/v3/projects/a5177742e24e4ed6adec745d6f16cb03/users/8a5666ae5f294fe889ce36fef5832f3a/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:14.207378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.208001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.208499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.241473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] MFA Rules not processed for user `8a5666ae5f294fe889ce36fef5832f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:14.242798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:14.355653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 937/1904] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:14.359738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.460576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe58efe-8f8a-45a0-982c-4cf72a61d139 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.465982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.466678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.466959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.467646 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.468317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.470443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.510252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 968/1905] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:14 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:14.511189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.527314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5d6d-6bbf-4297-b424-2dfce0d55c6d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.602360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.603043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.603420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.603573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.604808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.607205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.638475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 938/1906] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:14 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:14.642332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.658729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38169-67f6-49ca-9293-366f691ec78d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.669107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.670970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.671649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.672062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.672342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.672482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:14.673078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.674729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.688951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc21605-f16d-46c1-be77-15fc3c78757c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.695600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.696591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.697020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.697399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] PATH_INFO: `/v3/projects/38fd78b939a042f7981b9e97c85ac4d7` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.698982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fd78b939a042f7981b9e97c85ac4d7)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.699374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 969/1907] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:14.700280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.701453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.723320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e1377-356b-4556-95a6-b55c6a132436 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.731551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.732526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.732817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.733089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] PATH_INFO: `/v3/projects/04c3b5cf746b4ec89b3ae5080c441550/users/40f17f833a9f4e8a8512ecffa9ae9c1c/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.781852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c3b5cf746b4ec89b3ae5080c441550, user_id=40f17f833a9f4e8a8512ecffa9ae9c1c, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.785675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.788503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fd78b939a042f7981b9e97c85ac4d7', 'request_id': 'req-00c36840-6fbe-471c-8c34-81aac3dd1cd0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:14.809531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fd78b939a042f7981b9e97c85ac4d7', 'request_id': 'req-00c36840-6fbe-471c-8c34-81aac3dd1cd0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:14.816222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 970/1908] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:14 2022] PUT /identity/v3/projects/04c3b5cf746b4ec89b3ae5080c441550/users/40f17f833a9f4e8a8512ecffa9ae9c1c/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:14.820658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.823018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fd78b939a042f7981b9e97c85ac4d7', 'request_id': 'req-00c36840-6fbe-471c-8c34-81aac3dd1cd0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:14.844274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] The token cache is being invalidate because project 38fd78b939a042f7981b9e97c85ac4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:14.844718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:14.845633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:14.851758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 939/1909] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:14 2022] DELETE /identity/v3/projects/38fd78b939a042f7981b9e97c85ac4d7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:14.852852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.855073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:14.941915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dcc98-0002-4bdd-b1c1-276a4171b20b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:14.948533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:14.949650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:14.950272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:14.950737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:14.952284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:14.955528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:14.975083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 971/1910] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:14.976507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:14.982599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:14.996325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36840-6fbe-471c-8c34-81aac3dd1cd0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:15.007998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:15.010483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:15.010765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:15.011306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] PATH_INFO: `/v3/users/349bc9d4c89146668e74f0740de8410d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:15.013579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16fae-bbe1-490b-ba50-1b1477139345 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:15.015744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349bc9d4c89146668e74f0740de8410d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:15.030997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:15.033663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f25f-068e-4272-9941-e03f1817b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:15.034709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f25f-068e-4272-9941-e03f1817b603 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:15.035225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f25f-068e-4272-9941-e03f1817b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:15.035614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f25f-068e-4272-9941-e03f1817b603 admin admin] PATH_INFO: `/v3/projects/04c3b5cf746b4ec89b3ae5080c441550/users/40f17f833a9f4e8a8512ecffa9ae9c1c/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:15.042168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595f25f-068e-4272-9941-e03f1817b603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c3b5cf746b4ec89b3ae5080c441550, user_id=40f17f833a9f4e8a8512ecffa9ae9c1c, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:15.047867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595f25f-068e-4272-9941-e03f1817b603 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:15.085774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 972/1911] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:14 2022] PUT /identity/v3/projects/04c3b5cf746b4ec89b3ae5080c441550/users/40f17f833a9f4e8a8512ecffa9ae9c1c/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:15.089256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:15.089794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:15.090187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:15.150594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349bc9d4c89146668e74f0740de8410d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.150787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] MFA Rules not processed for user `40f17f833a9f4e8a8512ecffa9ae9c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:15.152100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:15.176380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349bc9d4c89146668e74f0740de8410d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.194479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349bc9d4c89146668e74f0740de8410d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.195253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349bc9d4c89146668e74f0740de8410d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.222798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349bc9d4c89146668e74f0740de8410d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.236287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 940/1912] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:14 2022] DELETE /identity/v3/users/349bc9d4c89146668e74f0740de8410d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:15.274375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 973/1913] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:15.289947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:15.291535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:15.376346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5914c5-9051-4280-a4c7-1d8e96a60958 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:15.390636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c57d-1b96-4a1b-a369-be43d57ff9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:15.391924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c57d-1b96-4a1b-a369-be43d57ff9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:15.393947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c57d-1b96-4a1b-a369-be43d57ff9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:15.394227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c57d-1b96-4a1b-a369-be43d57ff9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:15.469366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c57d-1b96-4a1b-a369-be43d57ff9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:15.472529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c57d-1b96-4a1b-a369-be43d57ff9f8 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:15.485276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 941/1914] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:15.716531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:15.718155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:15.808899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3427e5-e962-4a10-90fc-c1f47a2a9fec None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:15.879848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:15.880734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:15.881051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:15.881335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] PATH_INFO: `/v3/projects/88106e6be57c44d6952ff55d86fd70f3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:15.882602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88106e6be57c44d6952ff55d86fd70f3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:15.884547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:15.942671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88106e6be57c44d6952ff55d86fd70f3', 'request_id': 'req-591116b1-c51f-4aea-be18-b2a17e1a862c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.953100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88106e6be57c44d6952ff55d86fd70f3', 'request_id': 'req-591116b1-c51f-4aea-be18-b2a17e1a862c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.960333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88106e6be57c44d6952ff55d86fd70f3', 'request_id': 'req-591116b1-c51f-4aea-be18-b2a17e1a862c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.973175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] The token cache is being invalidate because project 88106e6be57c44d6952ff55d86fd70f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:15.974199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.974984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:15.977554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 974/1915] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:15 2022] DELETE /identity/v3/projects/88106e6be57c44d6952ff55d86fd70f3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:15.982744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c935-5a9c-4e47-a4e7-35ac9ca3f3c7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:15.983032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c935-5a9c-4e47-a4e7-35ac9ca3f3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:15.983308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c935-5a9c-4e47-a4e7-35ac9ca3f3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.006740 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f599c935-5a9c-4e47-a4e7-35ac9ca3f3c7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:16.008048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f599c935-5a9c-4e47-a4e7-35ac9ca3f3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.068929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.070661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.088689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 942/1916] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:16.096684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.096970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.097269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.116701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:16.117961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.133274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 943/1917] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:16.134388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.145291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf217ee-3e76-4b00-a843-794489c37b4c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.150945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.151741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.152018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.152290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.153130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:16.153441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.155118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.162261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591116b1-c51f-4aea-be18-b2a17e1a862c admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.167727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.168596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 944/1918] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:16.168705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.169067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.169553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] PATH_INFO: `/v3/users/8a5666ae5f294fe889ce36fef5832f3a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.170916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5666ae5f294fe889ce36fef5832f3a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.172781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.173018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.185457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a7797-90a2-4f00-a04e-68fcb7ba4791 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.190845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.191564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.191939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.192787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.193511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.195599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.225245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 945/1919] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:16.226784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5666ae5f294fe889ce36fef5832f3a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:16.229788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.237214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5666ae5f294fe889ce36fef5832f3a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:16.247291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5666ae5f294fe889ce36fef5832f3a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:16.262021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5666ae5f294fe889ce36fef5832f3a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:16.262896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-33f4bc60-8a42-4214-aa88-e2d5c8647f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5666ae5f294fe889ce36fef5832f3a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:16.269158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 975/1920] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:16 2022] DELETE /identity/v3/users/8a5666ae5f294fe889ce36fef5832f3a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:16.274671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.275005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.275289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.293887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:16.295137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.298520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1190-453a-48e8-97b7-22fcda7065bc admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.357818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 976/1921] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:16.364148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.367423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.367714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.367994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.368708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.371546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.372978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.375349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.404840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 946/1922] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:16.418935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.420680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.440223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091ab86-ddbe-4986-9e43-2fba616af80a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.447487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.448352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.448788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.449195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.450062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.451853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.461715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb46ab-55b0-4dba-9f31-f0e3e9b13b18 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.466297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 947/1923] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:16.468779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.469636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.469955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.470065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.470232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.486679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ddfa-6b5b-45bf-a134-45e419a7a336 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.488593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.491632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.492590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81c5d-7a2a-4ed0-894f-14bfd2f45541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.493262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81c5d-7a2a-4ed0-894f-14bfd2f45541 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.493542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81c5d-7a2a-4ed0-894f-14bfd2f45541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.493840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81c5d-7a2a-4ed0-894f-14bfd2f45541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.494564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81c5d-7a2a-4ed0-894f-14bfd2f45541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.496179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81c5d-7a2a-4ed0-894f-14bfd2f45541 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.506795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 977/1924] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:16.507734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 948/1925] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:16.512428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.522872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8f387-1e3c-465e-b255-42462046f661 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.528204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.529081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.529354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.529920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] PATH_INFO: `/v3/projects/d2165431ae59424d97c8cba24f374bca/users/715886ac16fe44929035b68ee777b9ea/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.551740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2165431ae59424d97c8cba24f374bca, user_id=715886ac16fe44929035b68ee777b9ea, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.557989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.575870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 978/1926] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:16 2022] PUT /identity/v3/projects/d2165431ae59424d97c8cba24f374bca/users/715886ac16fe44929035b68ee777b9ea/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:16.587402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.587801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.588176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.617090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] MFA Rules not processed for user `715886ac16fe44929035b68ee777b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:16.618778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.689702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 949/1927] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:16.693970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.762201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fca791-aa84-4c85-b9bb-4f34503da3da admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.768106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.769147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.769528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.769955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.771476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.775328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.808569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 979/1928] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:16.812934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.824809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.828693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:16.834640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30ef6-8fe5-4b26-ab23-24c9c1a1b8f3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.924016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.925094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.925371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.925644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.927586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.930145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.935902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906352b7-1394-44c3-a6e1-9fb02ed0b349 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.941496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.942978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.943284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.943629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] PATH_INFO: `/v3/projects/a5177742e24e4ed6adec745d6f16cb03` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.944841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5177742e24e4ed6adec745d6f16cb03)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.946831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.952977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 950/1929] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:16 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:16.956768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:16.967396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd2b25-5c5b-4a4c-b834-d9318972fc6f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:16.974013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:16.974841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:16.975187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:16.975660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:16.976646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:16.979984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:16.994352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 951/1930] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:16.995948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:17.003825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5177742e24e4ed6adec745d6f16cb03', 'request_id': 'req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.007273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14fa8b-2561-4fa2-95c5-c9b2a3e59455 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:17.014096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5177742e24e4ed6adec745d6f16cb03', 'request_id': 'req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.026641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5177742e24e4ed6adec745d6f16cb03', 'request_id': 'req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.039379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] The token cache is being invalidate because project a5177742e24e4ed6adec745d6f16cb03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:17.039803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.040548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.042598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 980/1931] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:16 2022] DELETE /identity/v3/projects/a5177742e24e4ed6adec745d6f16cb03 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:17.046634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:17.048145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.084028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:17.085529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.086060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.086735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] PATH_INFO: `/v3/projects/fcb24e9c873948988fe40438800f0ca5/users/76b5ae26ae314261a107ae11b6e84b6c/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.105542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb24e9c873948988fe40438800f0ca5, user_id=76b5ae26ae314261a107ae11b6e84b6c, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:17.111153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:17.137119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 952/1932] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:16 2022] PUT /identity/v3/projects/fcb24e9c873948988fe40438800f0ca5/users/76b5ae26ae314261a107ae11b6e84b6c/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:17.137801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4c247-ae0b-4a16-b2b9-eb07a8c8a043 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:17.140678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:17.143274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.215551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:17.216659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.217080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.217502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] PATH_INFO: `/v3/users/40f17f833a9f4e8a8512ecffa9ae9c1c` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.219360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f17f833a9f4e8a8512ecffa9ae9c1c)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:17.222760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:17.246813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba255d-76cf-43e8-a02d-ca086a9911b0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:17.252090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:17.252956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.253381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.253841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.255505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:17.257472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:17.278085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 953/1933] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:17.278915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:17.287530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f17f833a9f4e8a8512ecffa9ae9c1c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.289339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11daa41-a0e0-4cc9-a242-f5a7c0e187aa admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:17.294369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f17f833a9f4e8a8512ecffa9ae9c1c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.294503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a6fb-3737-4c0f-a2fc-8f18e94f913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:17.295272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a6fb-3737-4c0f-a2fc-8f18e94f913c admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.295551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a6fb-3737-4c0f-a2fc-8f18e94f913c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.295831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a6fb-3737-4c0f-a2fc-8f18e94f913c admin admin] PATH_INFO: `/v3/projects/fcb24e9c873948988fe40438800f0ca5/users/76b5ae26ae314261a107ae11b6e84b6c/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.297862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a6fb-3737-4c0f-a2fc-8f18e94f913c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb24e9c873948988fe40438800f0ca5, user_id=76b5ae26ae314261a107ae11b6e84b6c, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:17.300952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a6fb-3737-4c0f-a2fc-8f18e94f913c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:17.305000 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f17f833a9f4e8a8512ecffa9ae9c1c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.311897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 954/1934] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:17 2022] PUT /identity/v3/projects/fcb24e9c873948988fe40438800f0ca5/users/76b5ae26ae314261a107ae11b6e84b6c/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:17.318055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f17f833a9f4e8a8512ecffa9ae9c1c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.318841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f17f833a9f4e8a8512ecffa9ae9c1c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.323247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.323536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.323807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.325790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 981/1935] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:17 2022] DELETE /identity/v3/users/40f17f833a9f4e8a8512ecffa9ae9c1c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:17.353598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] MFA Rules not processed for user `76b5ae26ae314261a107ae11b6e84b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:17.355278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.442751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 955/1936] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:17.457608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:17.459182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.539437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e344a84-388f-42b6-a6dc-62f8d3ef2953 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:17.543668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9661a-21ed-4383-98a8-51ccb7f4e3d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:17.544410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9661a-21ed-4383-98a8-51ccb7f4e3d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.544752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9661a-21ed-4383-98a8-51ccb7f4e3d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.545532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9661a-21ed-4383-98a8-51ccb7f4e3d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.555839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9661a-21ed-4383-98a8-51ccb7f4e3d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:17.557432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9661a-21ed-4383-98a8-51ccb7f4e3d3 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:17.568475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 982/1937] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:17.631025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:17.632729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.723388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647fdd9-0a88-4b10-815e-65ceb8c515dd None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:17.730351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:17.731433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.731862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.732303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] PATH_INFO: `/v3/projects/04c3b5cf746b4ec89b3ae5080c441550` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.734954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c3b5cf746b4ec89b3ae5080c441550)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:17.737104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:17.806916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c3b5cf746b4ec89b3ae5080c441550', 'request_id': 'req-5c739fa3-a35f-4ee4-9e78-d805793b599c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.821444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c3b5cf746b4ec89b3ae5080c441550', 'request_id': 'req-5c739fa3-a35f-4ee4-9e78-d805793b599c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.833753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c3b5cf746b4ec89b3ae5080c441550', 'request_id': 'req-5c739fa3-a35f-4ee4-9e78-d805793b599c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.846580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] The token cache is being invalidate because project 04c3b5cf746b4ec89b3ae5080c441550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:17.846870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.848094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-5c739fa3-a35f-4ee4-9e78-d805793b599c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:17.852345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 956/1938] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:17 2022] DELETE /identity/v3/projects/04c3b5cf746b4ec89b3ae5080c441550 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:17.857242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.857714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.857846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.877097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:17.879806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.953779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 983/1939] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:17.961658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:17.961988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:17.962321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:17.987014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:17.988195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:17.997464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 957/1940] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:18.001544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.011581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc37c70-83b7-4dd8-bb9d-906654ca5c73 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.019530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.020606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.021369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.021854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.023884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:18.025089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.027427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.054096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.066546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 984/1941] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:18.067169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856494d9-a5e7-4eed-bf9d-0f1e55f7bae0 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.090526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.090721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.091808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.092266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.092728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.092862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.093811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.096296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.117982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86ecf-9478-4d42-914e-0e0869862c0b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.127218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.128441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.128789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.129231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] PATH_INFO: `/v3/users/715886ac16fe44929035b68ee777b9ea` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.137426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715886ac16fe44929035b68ee777b9ea)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.140759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.147308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 958/1942] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:18 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:18.148855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.232033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715886ac16fe44929035b68ee777b9ea'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:18.247753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715886ac16fe44929035b68ee777b9ea'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:18.264430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715886ac16fe44929035b68ee777b9ea'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:18.289991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715886ac16fe44929035b68ee777b9ea'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:18.291311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-60c6286e-f5cc-433c-a5ea-dda4558a0486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715886ac16fe44929035b68ee777b9ea'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:18.294410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd21c-b68a-4028-99b5-2d58fba04c6d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.305159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 985/1943] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:18 2022] DELETE /identity/v3/users/715886ac16fe44929035b68ee777b9ea => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:18.310478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.311156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.312495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.312854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.313029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.313834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.314115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.314809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.320019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.349939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:18.351615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.369085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 959/1944] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:18 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:18.369085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.371125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.453988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 986/1945] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:18.454973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.458680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.474901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988ec4d-1226-42c8-ae76-36023048872b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.486972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.489730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.489730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.490066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.491605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.494631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.504018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0aa7-32f2-47f4-a727-d9b6523859eb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.510471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 987/1946] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:18.511364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.513388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.593776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.594507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.594797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.595217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.597137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.597535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becb46d-9851-4c18-8a3c-f387f1bcd3be admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.602685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.605877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.607400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.608137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.623712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.625312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.644408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 988/1947] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:18.646197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.659981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd266a-7674-4d0c-bbac-f90878669b0c service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.666822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.667597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.668114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.669316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.670480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.672668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.691781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 989/1948] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:18.703380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:18.724283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c2741-224b-4bdc-b32c-90fc040ac982 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:18.741651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:18.742657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.742878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.743137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] PATH_INFO: `/v3/projects/a4c9b5145b4a42da80df2106f049c65e/users/ed98a271616d4b3da39c14a4e8eb1c59/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.745863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.747350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85311fdf-f341-41e5-b10b-c199b81a183f service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.771045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 960/1949] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:18.802342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c9b5145b4a42da80df2106f049c65e, user_id=ed98a271616d4b3da39c14a4e8eb1c59, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:18.805504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:18.833830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 990/1950] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:18 2022] PUT /identity/v3/projects/a4c9b5145b4a42da80df2106f049c65e/users/ed98a271616d4b3da39c14a4e8eb1c59/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:18.839604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:18.839861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:18.840143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:18.883524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] MFA Rules not processed for user `ed98a271616d4b3da39c14a4e8eb1c59`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:18.884929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:18.992866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 961/1951] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:18.994061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.091573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583728-8fe4-4936-adfd-de41338a80ba admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.096827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.097577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.097967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.098878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.099643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.102080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.120910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.122454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.143942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 991/1952] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:18 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:19.144673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e22d9-8466-45d9-83cc-fedba3a89af6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.148172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.220878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.220878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.220878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.220878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] PATH_INFO: `/v3/projects/d2165431ae59424d97c8cba24f374bca` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.221545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2165431ae59424d97c8cba24f374bca)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.222250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63000ea-8ca8-423d-be85-2146b09615fe admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.223754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.231309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.231979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.232256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.232525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.233208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.237239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.264012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 992/1953] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:19 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:19.268283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.281235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a063-7833-47a1-a7c0-20c35d4a13b0 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.293346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2165431ae59424d97c8cba24f374bca', 'request_id': 'req-dc5574ba-bea8-425c-8ca2-7a4622aaee36'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.303878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2165431ae59424d97c8cba24f374bca', 'request_id': 'req-dc5574ba-bea8-425c-8ca2-7a4622aaee36'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.316025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2165431ae59424d97c8cba24f374bca', 'request_id': 'req-dc5574ba-bea8-425c-8ca2-7a4622aaee36'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.329309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] The token cache is being invalidate because project d2165431ae59424d97c8cba24f374bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:19.329613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.330471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.333861 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 962/1954] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:19 2022] DELETE /identity/v3/projects/d2165431ae59424d97c8cba24f374bca => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:19.336642 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.338553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.365165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.366076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.366496 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.366905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.367776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.370239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.383309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 993/1955] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:19.387776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.389842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.402860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf746a7-b6e7-4a50-b711-b2c0339afa57 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.417061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.418731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.419017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.419293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] PATH_INFO: `/v3/projects/a21e8e7c1a18465880d025d28b5213a4/users/02659bb423434efc8a9224a27f3402e7/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.420766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5574ba-bea8-425c-8ca2-7a4622aaee36 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.428068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.429060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.429432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.429837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] PATH_INFO: `/v3/users/76b5ae26ae314261a107ae11b6e84b6c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.431174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b5ae26ae314261a107ae11b6e84b6c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.433209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.434868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21e8e7c1a18465880d025d28b5213a4, user_id=02659bb423434efc8a9224a27f3402e7, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.437535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.453074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 994/1956] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:19 2022] PUT /identity/v3/projects/a21e8e7c1a18465880d025d28b5213a4/users/02659bb423434efc8a9224a27f3402e7/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:19.453994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.456032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.491229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b5ae26ae314261a107ae11b6e84b6c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.499042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b5ae26ae314261a107ae11b6e84b6c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.507983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b5ae26ae314261a107ae11b6e84b6c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.508626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b5ae26ae314261a107ae11b6e84b6c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.522072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b5ae26ae314261a107ae11b6e84b6c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.528165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 963/1957] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:19 2022] DELETE /identity/v3/users/76b5ae26ae314261a107ae11b6e84b6c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:19.528920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.530325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.534402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6862c1-edf0-4059-bb28-8bb5e1ce6f08 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.596945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ffeff-c8c4-4bad-a41f-9dddf9e0b506 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.604629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.605669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.606203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.606363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.606485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] PATH_INFO: `/v3/users/924f96040dfe4118a5a9e8931c870767` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.607383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.607765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.607873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] RBAC: Authorizing `identity:delete_user(user_id=924f96040dfe4118a5a9e8931c870767)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.608203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.609115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.609855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.612257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.624733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 964/1958] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:19.628731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.641132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9151e-813b-42f4-ba9f-9ab2b26edd97 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.654713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f007383-b756-4800-8c39-1e741c9479b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.655614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f007383-b756-4800-8c39-1e741c9479b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.655891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f007383-b756-4800-8c39-1e741c9479b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.656163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f007383-b756-4800-8c39-1e741c9479b2 admin admin] PATH_INFO: `/v3/projects/a21e8e7c1a18465880d025d28b5213a4/users/02659bb423434efc8a9224a27f3402e7/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.658544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f007383-b756-4800-8c39-1e741c9479b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21e8e7c1a18465880d025d28b5213a4, user_id=02659bb423434efc8a9224a27f3402e7, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.662149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f007383-b756-4800-8c39-1e741c9479b2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.671468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924f96040dfe4118a5a9e8931c870767'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.674236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 965/1959] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:19 2022] PUT /identity/v3/projects/a21e8e7c1a18465880d025d28b5213a4/users/02659bb423434efc8a9224a27f3402e7/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:19.679045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924f96040dfe4118a5a9e8931c870767'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.685089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662366-d580-4112-b896-e59fd651d004 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.685376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662366-d580-4112-b896-e59fd651d004 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.685650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662366-d580-4112-b896-e59fd651d004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.687120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924f96040dfe4118a5a9e8931c870767'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.700625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924f96040dfe4118a5a9e8931c870767'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.701329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-62c00a8c-b144-47aa-a164-4488dbb6294e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924f96040dfe4118a5a9e8931c870767'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.707284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 995/1960] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:19 2022] DELETE /identity/v3/users/924f96040dfe4118a5a9e8931c870767 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:19.712344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.712688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.713068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.721456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b1662366-d580-4112-b896-e59fd651d004 None None] MFA Rules not processed for user `02659bb423434efc8a9224a27f3402e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:19.722799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b1662366-d580-4112-b896-e59fd651d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.734369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:19.735677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.799060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 996/1961] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:19.803080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 966/1962] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:19.810525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.810669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662366-d580-4112-b896-e59fd651d004 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.811957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.812184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b1662366-d580-4112-b896-e59fd651d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.873322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f849dc-9638-4386-a41f-e8d3d019528a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.877766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.878548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.878777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.879138 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.883393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662366-d580-4112-b896-e59fd651d004 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.888446 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.889212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.889424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.889532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.889795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.890913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.892081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.900976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 997/1963] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:19.901980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:19.903276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:19.920013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde5b40-fd35-4a68-989a-958987fa0ad6 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:19.924750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:19.925635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:19.926047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:19.927003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] PATH_INFO: `/v3/projects/fcb24e9c873948988fe40438800f0ca5` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:19.928252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb24e9c873948988fe40438800f0ca5)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.930276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.956009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:19.957863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509372b-f427-4dc1-9169-5721dfd977d4 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:19.968306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 967/1964] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:19.986094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb24e9c873948988fe40438800f0ca5', 'request_id': 'req-61f2c71c-ca7d-4942-91eb-06fa3404de9a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:19.994580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb24e9c873948988fe40438800f0ca5', 'request_id': 'req-61f2c71c-ca7d-4942-91eb-06fa3404de9a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.000663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb24e9c873948988fe40438800f0ca5', 'request_id': 'req-61f2c71c-ca7d-4942-91eb-06fa3404de9a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.014226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] The token cache is being invalidate because project fcb24e9c873948988fe40438800f0ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:20.014712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.015427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-61f2c71c-ca7d-4942-91eb-06fa3404de9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.019412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 998/1965] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:19 2022] DELETE /identity/v3/projects/fcb24e9c873948988fe40438800f0ca5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:20.024177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.024822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.025984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.053046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:20.054494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.142329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 968/1966] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:20.150248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.150535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.150811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.174183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:20.176097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.185979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 999/1967] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:20.190626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.203138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6591c-fd4d-4e62-98c2-db6b1c535ea6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.208507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.209240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.209562 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.209870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.210699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:20.211035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.212877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.235009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 969/1968] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:20.235866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.245768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41005134-d782-42ea-b306-ed45f26a6869 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.253091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.253774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.254269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.254543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.255306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.257418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.273375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.275216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.297972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f7a6-b7a0-45e5-acd8-2766dd6fd68c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.298301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1000/1969] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:20.305992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.385211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.386253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.386596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.386955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] PATH_INFO: `/v3/projects/ae709cf115cb4cb28cfb9e36ca79a063` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.388462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae709cf115cb4cb28cfb9e36ca79a063)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.390765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.393773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec225d8-b27a-492a-a820-7f123e996e1e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.401085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.402005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.402461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.402929 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.403762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.406220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.431281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1001/1970] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:20.435704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.446606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af04fb-0f55-4796-b671-8f11b6fc8fe4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.453122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae709cf115cb4cb28cfb9e36ca79a063', 'request_id': 'req-d137e9b7-ac73-438e-81ca-180af754b3f2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.459554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae709cf115cb4cb28cfb9e36ca79a063', 'request_id': 'req-d137e9b7-ac73-438e-81ca-180af754b3f2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.465505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae709cf115cb4cb28cfb9e36ca79a063', 'request_id': 'req-d137e9b7-ac73-438e-81ca-180af754b3f2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.477054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] The token cache is being invalidate because project ae709cf115cb4cb28cfb9e36ca79a063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:20.477269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.477961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.479564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 970/1971] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:20 2022] DELETE /identity/v3/projects/ae709cf115cb4cb28cfb9e36ca79a063 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:20.483591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.484970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.506531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.507326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.507603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.507873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.508624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.510269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.520103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1002/1972] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:20.523818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.525525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.537350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aaeb5-376f-4240-aa02-f02fde3afc07 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.541915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.542553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.542830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.543093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.543803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.545376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.547419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137e9b7-ac73-438e-81ca-180af754b3f2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.552592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.553459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.553755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.554040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] PATH_INFO: `/v3/users/08e0e24633f54e3c809528e28579ff42` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.555228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e0e24633f54e3c809528e28579ff42)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.558518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1003/1973] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:20.558661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.559423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.569303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b2fcc-7eb7-4a44-84c3-9c4c27d7f87a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.573775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff039ac1-a7fd-41e8-b0cf-a006f3f7f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.574648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff039ac1-a7fd-41e8-b0cf-a006f3f7f06c admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.574922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff039ac1-a7fd-41e8-b0cf-a006f3f7f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.575188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff039ac1-a7fd-41e8-b0cf-a006f3f7f06c admin admin] PATH_INFO: `/v3/projects/40749ddbf5934a24b1d9347fe6cfa850/users/3ade30015f76421184120bdae8863f79/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.590316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff039ac1-a7fd-41e8-b0cf-a006f3f7f06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40749ddbf5934a24b1d9347fe6cfa850, user_id=3ade30015f76421184120bdae8863f79, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.593098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff039ac1-a7fd-41e8-b0cf-a006f3f7f06c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.602372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e0e24633f54e3c809528e28579ff42'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.607695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1004/1974] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:20 2022] PUT /identity/v3/projects/40749ddbf5934a24b1d9347fe6cfa850/users/3ade30015f76421184120bdae8863f79/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:20.609036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e0e24633f54e3c809528e28579ff42'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.616766 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e0e24633f54e3c809528e28579ff42'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.617723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e0e24633f54e3c809528e28579ff42'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.619254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.619928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.620208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.629395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e0e24633f54e3c809528e28579ff42'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:20.635730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 971/1975] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:20 2022] DELETE /identity/v3/users/08e0e24633f54e3c809528e28579ff42 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:20.648637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] MFA Rules not processed for user `3ade30015f76421184120bdae8863f79`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:20.649843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.725247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1005/1976] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:20.730207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.731985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.807418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e93f3-6c4e-4698-9dbc-2e73d4d20fae admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.813528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.814233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.814516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.814791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.816246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.818686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.845111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 972/1977] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:20.849698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.860447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a6ab7-ebd6-4dc7-8b9a-ebd51cb1b2c5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.916543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.917213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.917497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.917803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.918493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.920449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.923255 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.924957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:20.938012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590dd5-25f3-45a3-9c89-3cb8433e9018 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.941482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1006/1978] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:20 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:20.943358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.944343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.944622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.945218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] PATH_INFO: `/v3/projects/99d6b0a11def44ac90320e7915925497` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.946475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d6b0a11def44ac90320e7915925497)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.946878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.948387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.957351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ce022-8582-446b-ac6e-26bea0d03030 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.962893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:20.963669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:20.964394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:20.964689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:20.965446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:20.967076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:20.977854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1007/1979] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:20.981698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:20.991675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2b4db-f584-4b21-b4ff-8e68274227e2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:20.997189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d6b0a11def44ac90320e7915925497', 'request_id': 'req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:21.005820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d6b0a11def44ac90320e7915925497', 'request_id': 'req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:21.011039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d6b0a11def44ac90320e7915925497', 'request_id': 'req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:21.022292 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] The token cache is being invalidate because project 99d6b0a11def44ac90320e7915925497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:21.022571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:21.023208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7630fb9b-ca58-40c8-bdc5-3b495c12c50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:21.024748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 973/1980] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:20 2022] DELETE /identity/v3/projects/99d6b0a11def44ac90320e7915925497 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:21.029507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07610-ad36-4ef7-a0eb-f67507d90fdd None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.029815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07610-ad36-4ef7-a0eb-f67507d90fdd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.030094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07610-ad36-4ef7-a0eb-f67507d90fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.047431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.047974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c8f07610-ad36-4ef7-a0eb-f67507d90fdd None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:21.048310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.048585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.048685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c8f07610-ad36-4ef7-a0eb-f67507d90fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.048848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] PATH_INFO: `/v3/projects/460d46da5dcd4d3b864471ced0c884ec/users/bb78b6b2b68f4e11b8ab238d3f5b820b/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.057112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 974/1981] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:21.063301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460d46da5dcd4d3b864471ced0c884ec, user_id=bb78b6b2b68f4e11b8ab238d3f5b820b, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.064645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.064930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.065205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.065997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.080723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1008/1982] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:20 2022] PUT /identity/v3/projects/460d46da5dcd4d3b864471ced0c884ec/users/bb78b6b2b68f4e11b8ab238d3f5b820b/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:21.083640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:21.084412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.084841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.086275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.142108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 975/1983] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:21.146210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.146784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb00f79-ff72-4959-a455-6db027b40c18 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.150991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.151655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.151935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.152210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.152975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.154626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.154749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489ac2a-b255-46d0-9980-7d7c39969ac6 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.159765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.160059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.160332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.160625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.161899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:21.162204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.163806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.167972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1009/1984] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:21.168790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.178792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 976/1985] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:21.178936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a1f96-ac81-408b-9656-98cde78436e1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.180050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.183264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf71f-ef96-4b49-b1a8-ed9fac554ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.184121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf71f-ef96-4b49-b1a8-ed9fac554ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.184397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf71f-ef96-4b49-b1a8-ed9fac554ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.184669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf71f-ef96-4b49-b1a8-ed9fac554ebe admin admin] PATH_INFO: `/v3/projects/460d46da5dcd4d3b864471ced0c884ec/users/bb78b6b2b68f4e11b8ab238d3f5b820b/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.186742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf71f-ef96-4b49-b1a8-ed9fac554ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=460d46da5dcd4d3b864471ced0c884ec, user_id=bb78b6b2b68f4e11b8ab238d3f5b820b, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.189217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c46cb-7396-45b1-84ce-570e27015438 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.189415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf71f-ef96-4b49-b1a8-ed9fac554ebe admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.193911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.194542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.194823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.195093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.195794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.197912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.199307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1010/1986] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:21 2022] PUT /identity/v3/projects/460d46da5dcd4d3b864471ced0c884ec/users/bb78b6b2b68f4e11b8ab238d3f5b820b/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:21.211028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.211315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.211591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.227026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 977/1987] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:21.231077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.239532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] MFA Rules not processed for user `bb78b6b2b68f4e11b8ab238d3f5b820b`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:21.240654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.290919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cf06-54bc-49ec-b3ba-0e7a5ab928a1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.295574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.296232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.296505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.296774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.297445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.299400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.307580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1011/1988] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:21.320874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.322334 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.322841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 978/1989] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:21.326460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.338277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6df98-a527-4440-b25b-aeab1cdb2586 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.343720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.344384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.344661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.344932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.345648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.347293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.359714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 979/1990] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:21.365122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.383527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005f61-1195-4aba-b87d-68b8a75e48f1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.389609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.390714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.390826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.391197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.392122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.393940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.394919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57615016-9c19-4647-9463-d54f5e422c09 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.400839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eafc5-e4f3-4e0e-b5eb-7d2b75956d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.401818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eafc5-e4f3-4e0e-b5eb-7d2b75956d4c service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.402493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eafc5-e4f3-4e0e-b5eb-7d2b75956d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.402921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eafc5-e4f3-4e0e-b5eb-7d2b75956d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.412986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eafc5-e4f3-4e0e-b5eb-7d2b75956d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.413260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 980/1991] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:21.414488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eafc5-e4f3-4e0e-b5eb-7d2b75956d4c service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.414971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.425781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1012/1992] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:21.430264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4611a-a11d-447a-b7a8-071c6e87c4ce admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.435381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.436302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.436584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.436858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] PATH_INFO: `/v3/projects/b81c5ed83b8342ee8431bd090f2084c8/users/56ae0a102245470aafd9d98cc68d3f30/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.453595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81c5ed83b8342ee8431bd090f2084c8, user_id=56ae0a102245470aafd9d98cc68d3f30, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.458416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.480376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 981/1993] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:21 2022] PUT /identity/v3/projects/b81c5ed83b8342ee8431bd090f2084c8/users/56ae0a102245470aafd9d98cc68d3f30/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:21.491474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.491682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.491956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.514503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.535398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] MFA Rules not processed for user `56ae0a102245470aafd9d98cc68d3f30`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:21.536739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.578469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c9c5a-1fdf-4c19-ba4e-83ca04bce3ef admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.582308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.583592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.583872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.584148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.586022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:21.599854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1013/1994] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:21.604567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.644318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.646451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.655077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 982/1995] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:21.662829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460d455-49fd-42d7-8899-fc942f3fc0f8 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.667419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.668192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.668477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.668751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.669430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.671398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.701139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1014/1996] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:21.702309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.713619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7af9e6-98f8-41aa-bae2-206f9c44d863 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.773330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.774040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.774317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.774586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.775261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.777361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.797295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 983/1997] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:21 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:21.801330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.811902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb152079-d5f0-4c70-9fc4-f14cb5aef6bd admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.816523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.817210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.817491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.817793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.818962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.820749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.836219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1015/1998] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:21.837412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.847411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe12f7-d6ff-41eb-9af7-1ae1b4a7a854 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.852998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.853917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.854197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.854469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] PATH_INFO: `/v3/projects/ad9f315eaa3648cebd757b6be1e7e4cb/users/b55e19113111484cbb21d13bdca7fce6/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.871008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9f315eaa3648cebd757b6be1e7e4cb, user_id=b55e19113111484cbb21d13bdca7fce6, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.873705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.891548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 984/1999] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:21 2022] PUT /identity/v3/projects/ad9f315eaa3648cebd757b6be1e7e4cb/users/b55e19113111484cbb21d13bdca7fce6/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:21.893069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.903583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99c6c-0f36-4bb8-9c7b-21c6429e06e2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.918614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.969695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.970401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.970682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.970962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.972312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:21.974580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:21.987939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1016/2000] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:21.988092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed762f5-6db4-44f3-812e-eb0979e9181d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:21.990058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:21.992715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:21.993549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:21.993940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:21.994136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] PATH_INFO: `/v3/users/3ade30015f76421184120bdae8863f79` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:21.998603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ade30015f76421184120bdae8863f79)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:22.000560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:22.001297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7855-743f-40db-804c-a14e76cd4216 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:22.006034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9c24e-10cc-4b1f-8e21-819b5e07e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:22.006971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c24e-10cc-4b1f-8e21-819b5e07e94f admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.007310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c24e-10cc-4b1f-8e21-819b5e07e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.007657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9c24e-10cc-4b1f-8e21-819b5e07e94f admin admin] PATH_INFO: `/v3/projects/ad9f315eaa3648cebd757b6be1e7e4cb/users/b55e19113111484cbb21d13bdca7fce6/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.009731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9c24e-10cc-4b1f-8e21-819b5e07e94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9f315eaa3648cebd757b6be1e7e4cb, user_id=b55e19113111484cbb21d13bdca7fce6, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:22.012478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9c24e-10cc-4b1f-8e21-819b5e07e94f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:22.023569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1017/2001] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:21 2022] PUT /identity/v3/projects/ad9f315eaa3648cebd757b6be1e7e4cb/users/b55e19113111484cbb21d13bdca7fce6/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:22.034807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.035097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.035358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.046721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ade30015f76421184120bdae8863f79'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.053412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ade30015f76421184120bdae8863f79'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.059938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ade30015f76421184120bdae8863f79'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.060566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ade30015f76421184120bdae8863f79'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.062440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] MFA Rules not processed for user `b55e19113111484cbb21d13bdca7fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:22.063708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:22.072291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-77d16e05-1575-44f4-a1a2-47e2961d810f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ade30015f76421184120bdae8863f79'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.078483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 985/2002] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:21 2022] DELETE /identity/v3/users/3ade30015f76421184120bdae8863f79 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:22.083391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.083680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.083954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.102224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:22.103420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:22.134841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1018/2003] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:22.146277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:22.147734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:22.160621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 986/2004] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:22.170813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:22.173488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:22.207222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b050b60-6b2d-4606-bc47-d9f591533dfb None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:22.234873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b478d56-cc09-4657-93f0-3d8330faefb3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:22.238632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:22.239870 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.240155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.240814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.250403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:22.252398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:22.256963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:22.257558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.257894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.258173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.266693 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 987/2005] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:22.329950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:22.331560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:22.343162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1019/2006] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:22.740289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:22.741698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:22.772159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b271b-ebae-4492-8ea2-dd722ddc66c5 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:22.776810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:22.777678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.778113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.778504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] PATH_INFO: `/v3/projects/40749ddbf5934a24b1d9347fe6cfa850` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.779756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40749ddbf5934a24b1d9347fe6cfa850)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:22.781695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:22.838824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40749ddbf5934a24b1d9347fe6cfa850', 'request_id': 'req-c58111e5-3336-4238-8df3-0da91dc11877'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.847708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40749ddbf5934a24b1d9347fe6cfa850', 'request_id': 'req-c58111e5-3336-4238-8df3-0da91dc11877'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.854790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40749ddbf5934a24b1d9347fe6cfa850', 'request_id': 'req-c58111e5-3336-4238-8df3-0da91dc11877'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.868013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] The token cache is being invalidate because project 40749ddbf5934a24b1d9347fe6cfa850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:22.868342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.868966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:22.871033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 988/2007] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:22 2022] DELETE /identity/v3/projects/40749ddbf5934a24b1d9347fe6cfa850 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:22.875183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:22.890231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e60c2-f42e-4fa9-81de-6c20682d5f71 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:22.964130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:22.965123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:22.965406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:22.965726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] PATH_INFO: `/v3/users/bb78b6b2b68f4e11b8ab238d3f5b820b` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:22.967208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb78b6b2b68f4e11b8ab238d3f5b820b)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:22.969309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.033072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb78b6b2b68f4e11b8ab238d3f5b820b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.041638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb78b6b2b68f4e11b8ab238d3f5b820b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.049774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb78b6b2b68f4e11b8ab238d3f5b820b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.065556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb78b6b2b68f4e11b8ab238d3f5b820b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.066738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-351d8650-0109-4747-95d0-fb349c15ed55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb78b6b2b68f4e11b8ab238d3f5b820b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.079534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1020/2008] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:22 2022] DELETE /identity/v3/users/bb78b6b2b68f4e11b8ab238d3f5b820b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:23.087689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.089314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.102847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58111e5-3336-4238-8df3-0da91dc11877 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:23.158287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:23.159201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.159601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.159881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] PATH_INFO: `/v3/users/56ae0a102245470aafd9d98cc68d3f30` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.161667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ae0a102245470aafd9d98cc68d3f30)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:23.163634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.208806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ae0a102245470aafd9d98cc68d3f30'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.215799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ae0a102245470aafd9d98cc68d3f30'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.224751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ae0a102245470aafd9d98cc68d3f30'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.225942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ae0a102245470aafd9d98cc68d3f30'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.239799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ae0a102245470aafd9d98cc68d3f30'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.245698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 989/2009] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:23 2022] DELETE /identity/v3/users/56ae0a102245470aafd9d98cc68d3f30 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:23.250487 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.250834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.251144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.269012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:23.270224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.330645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1021/2010] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:23.345049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.346666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.404916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859958-09ba-4ec2-b25a-8899a22cc0f5 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:23.408722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cb5e-ceaf-4267-ab22-b94e31a48465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:23.409368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cb5e-ceaf-4267-ab22-b94e31a48465 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.409650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cb5e-ceaf-4267-ab22-b94e31a48465 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.409944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cb5e-ceaf-4267-ab22-b94e31a48465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.419600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161cb5e-ceaf-4267-ab22-b94e31a48465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:23.421055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161cb5e-ceaf-4267-ab22-b94e31a48465 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.430041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.431671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.432637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 990/2011] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:23.446491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981fbd-32ca-44ab-b005-0672b31663d9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:23.453484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:23.454397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.454672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.454941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] PATH_INFO: `/v3/projects/460d46da5dcd4d3b864471ced0c884ec` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.458904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460d46da5dcd4d3b864471ced0c884ec)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:23.461210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.515344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460d46da5dcd4d3b864471ced0c884ec', 'request_id': 'req-16523bc8-48c2-4878-919b-2082172137d3'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.524453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460d46da5dcd4d3b864471ced0c884ec', 'request_id': 'req-16523bc8-48c2-4878-919b-2082172137d3'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.530299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460d46da5dcd4d3b864471ced0c884ec', 'request_id': 'req-16523bc8-48c2-4878-919b-2082172137d3'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.543090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] The token cache is being invalidate because project 460d46da5dcd4d3b864471ced0c884ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:23.543681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.544041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-16523bc8-48c2-4878-919b-2082172137d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.545604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1022/2012] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:23 2022] DELETE /identity/v3/projects/460d46da5dcd4d3b864471ced0c884ec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:23.550520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.550805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.552139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.575855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:23.577195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.661852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 991/2013] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:23.663157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.663441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.663745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.694164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:23.695686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.711845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1023/2014] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:23.716578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.737938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd1796-f28c-4050-a2de-6c7eb3d3816a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:23.744400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:23.745160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.745553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.745914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.746718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:23.747024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:23.748636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.750056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.751515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.763104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 992/2015] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:23.771321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.772533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a81a5-c748-4aef-965e-daf4c9533bef None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:23.777785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:23.778598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.778878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.779195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] PATH_INFO: `/v3/projects/b81c5ed83b8342ee8431bd090f2084c8` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.780447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81c5ed83b8342ee8431bd090f2084c8)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:23.782501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210f549-c3cd-4aff-8704-fc9e8c5e63a4 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:23.782620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.788908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:23.789811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:23.790170 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:23.790502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:23.791266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:23.793351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:23.831995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 993/2016] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:23 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:23.832968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.846708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81c5ed83b8342ee8431bd090f2084c8', 'request_id': 'req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.861918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81c5ed83b8342ee8431bd090f2084c8', 'request_id': 'req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.867402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81c5ed83b8342ee8431bd090f2084c8', 'request_id': 'req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.900328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] The token cache is being invalidate because project b81c5ed83b8342ee8431bd090f2084c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:23.900994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.902419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:23.907593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1024/2017] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:23 2022] DELETE /identity/v3/projects/b81c5ed83b8342ee8431bd090f2084c8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:23.908466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:23.911223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:23.918734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b273d-e724-4d90-8bb0-14f950ecf8ef admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.002042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc5e1f-7d4f-45e0-bfa7-a737010887d1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.003041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.003915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.004274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.005186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.006312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.008291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.008738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.009335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.009615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.010015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] PATH_INFO: `/v3/users/b55e19113111484cbb21d13bdca7fce6` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.020869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55e19113111484cbb21d13bdca7fce6)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.024024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.036679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 994/2018] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:23 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:24.037703 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.039589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.055065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5c0d-5439-41a7-b3b5-f07b5f9955ac admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.061067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.062694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.065238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.065238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.065238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.067714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.087640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 995/2019] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:24.092221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.107565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ee64f-e2f2-4033-89ff-51c578800818 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.110928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.111507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.111793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.112184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.113318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.115590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.119202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55e19113111484cbb21d13bdca7fce6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.126556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 996/2020] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:24.128276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55e19113111484cbb21d13bdca7fce6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.130469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.136274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55e19113111484cbb21d13bdca7fce6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.141594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea959-f5ab-4dc1-9112-68fabf612714 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.146463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.147341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.147618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.147887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] PATH_INFO: `/v3/projects/fc6861e4f4624f8189584b7671892dae/users/1f5b8ae5ac344d709192c5d64b299b14/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.151016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55e19113111484cbb21d13bdca7fce6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.151920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b5025e47-8915-4167-ab2c-5e19726b4b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55e19113111484cbb21d13bdca7fce6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.159773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1025/2021] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:23 2022] DELETE /identity/v3/users/b55e19113111484cbb21d13bdca7fce6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:24.162840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6861e4f4624f8189584b7671892dae, user_id=1f5b8ae5ac344d709192c5d64b299b14, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.168643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.183521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 997/2022] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:24 2022] PUT /identity/v3/projects/fc6861e4f4624f8189584b7671892dae/users/1f5b8ae5ac344d709192c5d64b299b14/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:24.194873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.195162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.195435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.225596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] MFA Rules not processed for user `1f5b8ae5ac344d709192c5d64b299b14`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:24.227098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.310320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1026/2023] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:24.322715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.324614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.409602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a21653-7b12-47ba-bfbe-7afc1c2de371 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.417268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.417971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.418252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.418527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.430058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.431564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.440977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 998/2024] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:24.461237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.463131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.538720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.540004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06730ed-43f3-4dad-b9df-3dd5d404bfd5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.540425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.546358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.547301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.548030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.548030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] PATH_INFO: `/v3/users/1f5b8ae5ac344d709192c5d64b299b14` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.550117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5b8ae5ac344d709192c5d64b299b14)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.552714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.574361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd01a56-6239-4277-8545-72613f5e15c1 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.581647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.582855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.583092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.583366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] PATH_INFO: `/v3/projects/ad9f315eaa3648cebd757b6be1e7e4cb` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.584805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9f315eaa3648cebd757b6be1e7e4cb)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.587132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.609227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5b8ae5ac344d709192c5d64b299b14'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.616683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5b8ae5ac344d709192c5d64b299b14'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.624434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5b8ae5ac344d709192c5d64b299b14'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.637856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5b8ae5ac344d709192c5d64b299b14'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.639225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e137c25-29d8-4b4b-aa64-89c102256c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5b8ae5ac344d709192c5d64b299b14'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.642370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9f315eaa3648cebd757b6be1e7e4cb', 'request_id': 'req-65492589-e05f-43cb-bab2-7ed820650877'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.645475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1027/2025] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:24 2022] DELETE /identity/v3/users/1f5b8ae5ac344d709192c5d64b299b14 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:24.650012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9f315eaa3648cebd757b6be1e7e4cb', 'request_id': 'req-65492589-e05f-43cb-bab2-7ed820650877'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.650222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.650452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.650691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.659006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9f315eaa3648cebd757b6be1e7e4cb', 'request_id': 'req-65492589-e05f-43cb-bab2-7ed820650877'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.670502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] The token cache is being invalidate because project ad9f315eaa3648cebd757b6be1e7e4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:24.670785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.671442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-65492589-e05f-43cb-bab2-7ed820650877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.671636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:24.672845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.673198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 999/2026] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:24 2022] DELETE /identity/v3/projects/ad9f315eaa3648cebd757b6be1e7e4cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:24.678568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.678854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.679124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.704605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:24.705830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.742979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1028/2027] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:24.742979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.749959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.762942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db9b74-5770-4eb0-97fb-ddb6bf059a1e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.767754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.768579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.768885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.769127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] PATH_INFO: `/v3/users/ed98a271616d4b3da39c14a4e8eb1c59` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.770914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed98a271616d4b3da39c14a4e8eb1c59)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.772867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.773470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1000/2028] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:24.780238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.781022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.824167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed98a271616d4b3da39c14a4e8eb1c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.830744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed98a271616d4b3da39c14a4e8eb1c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.836134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cba075-da02-4406-b39c-1a944a7e18bb None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.838087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed98a271616d4b3da39c14a4e8eb1c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.840298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9efd60-b872-406e-a3e5-2989c555e2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.840913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efd60-b872-406e-a3e5-2989c555e2bb service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.841192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efd60-b872-406e-a3e5-2989c555e2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.841468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9efd60-b872-406e-a3e5-2989c555e2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.849950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed98a271616d4b3da39c14a4e8eb1c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.850454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9efd60-b872-406e-a3e5-2989c555e2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.850599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bfdaca87-cb6d-4c27-96c1-41728f50d714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed98a271616d4b3da39c14a4e8eb1c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:24.852183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9efd60-b872-406e-a3e5-2989c555e2bb service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.856588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1029/2029] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:24 2022] DELETE /identity/v3/users/ed98a271616d4b3da39c14a4e8eb1c59 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:24.860679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.860961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.861230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.861651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1001/2030] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:24.863067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.863403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.863624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.884503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:24.885725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.888999 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:24.890242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.953099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1030/2031] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:24.954201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1002/2032] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:24.957243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.964037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:24.965387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:24.967556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc06f4-57ab-4977-a9c4-7887beeeea8f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:24.973202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:24.973908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:24.974189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:24.974461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:24.975353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:24.976047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:24.977682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:24.990603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1031/2033] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:24.995105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.007932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da6d26-ca7d-425b-a066-cef43fa544fb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.013861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.014520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.014800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.015075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.015797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.017758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.046328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1032/2034] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:24 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:25.051212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.054811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61e81e-2c8f-4e14-b737-f9eb3f0272fa None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.124761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1b2b4-84a9-4d35-b2e0-5100f052fcaa admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.135688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.136537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.137059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.137434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.138260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.140486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.149440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.150201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.150718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.151069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.167760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.169263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.177923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1033/2035] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:25.179113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.180188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1003/2036] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:25.180927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.183345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.192967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52caf6-d6c0-4dd4-b032-ab6f41059370 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.199008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.200106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.200396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.200659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.201428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.203171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.206423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91d9f-dddd-4b22-8454-848ac5be3873 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.213044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.213988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.214333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.214669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] PATH_INFO: `/v3/projects/fc6861e4f4624f8189584b7671892dae` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.214841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1004/2037] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:25.215966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6861e4f4624f8189584b7671892dae)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.218017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.218477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.230642 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189ba13-ec4d-4f78-aece-f7072f379ba5 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.236932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.237658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.238132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.238411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.239722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.246972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.261253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1005/2038] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:25.264916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.275576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d5340-2609-4050-835d-f4ecaea05d27 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.277084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6861e4f4624f8189584b7671892dae', 'request_id': 'req-912f3fe6-c2a0-4138-9537-1d6b68685af8'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.286036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6861e4f4624f8189584b7671892dae', 'request_id': 'req-912f3fe6-c2a0-4138-9537-1d6b68685af8'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.293613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6861e4f4624f8189584b7671892dae', 'request_id': 'req-912f3fe6-c2a0-4138-9537-1d6b68685af8'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.305986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] The token cache is being invalidate because project fc6861e4f4624f8189584b7671892dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:25.306356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.307092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-912f3fe6-c2a0-4138-9537-1d6b68685af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.308848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1034/2039] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:25 2022] DELETE /identity/v3/projects/fc6861e4f4624f8189584b7671892dae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:25.314486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7410c4-4f65-47f9-92c5-320020ef8d6c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.314774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7410c4-4f65-47f9-92c5-320020ef8d6c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.315051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7410c4-4f65-47f9-92c5-320020ef8d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.333419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-6c7410c4-4f65-47f9-92c5-320020ef8d6c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:25.334669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6c7410c4-4f65-47f9-92c5-320020ef8d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.339451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d938d73-a7d9-4cc1-829c-cf90fe9212c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.340400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d938d73-a7d9-4cc1-829c-cf90fe9212c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.340592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d938d73-a7d9-4cc1-829c-cf90fe9212c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.340955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d938d73-a7d9-4cc1-829c-cf90fe9212c6 admin admin] PATH_INFO: `/v3/projects/33cb10b718594b12aa46678a23900308/users/7b7fc7d8f56d46dc8d018d2eeefb2237/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.343508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1035/2040] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:25.351412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.351771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.352054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.357284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d938d73-a7d9-4cc1-829c-cf90fe9212c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cb10b718594b12aa46678a23900308, user_id=7b7fc7d8f56d46dc8d018d2eeefb2237, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.360815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d938d73-a7d9-4cc1-829c-cf90fe9212c6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.373458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:25.374976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.381478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1006/2041] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:25 2022] PUT /identity/v3/projects/33cb10b718594b12aa46678a23900308/users/7b7fc7d8f56d46dc8d018d2eeefb2237/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:25.391734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.392028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.392304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.422080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] MFA Rules not processed for user `7b7fc7d8f56d46dc8d018d2eeefb2237`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:25.423289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.446185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1036/2042] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:25.450771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.460701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610a10-d446-452d-acb7-ea91763cc220 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.465609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.466365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.466706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.467045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.467843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:25.468336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.470136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.491505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1037/2043] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:25.494745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.505849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f23664-0c83-4f3d-95a7-8974c40f27cf admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.511221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.511951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.512257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.512579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.513240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.517077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.536153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1007/2044] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:25.537904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.541782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.553962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1038/2045] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:25.556773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.560024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.569156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9599529-df1b-42ec-9813-fa2e0e4c6939 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.621549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b291e-3b7b-4017-a988-49acf8a60a6b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.625359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.626101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.626392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.626666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.635079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.636019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.636366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.636705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] PATH_INFO: `/v3/projects/a4c9b5145b4a42da80df2106f049c65e` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.638560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c9b5145b4a42da80df2106f049c65e)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.640881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.688683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.690090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c9b5145b4a42da80df2106f049c65e', 'request_id': 'req-1eba8949-b211-40f6-ad9e-863a0eee22e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.690228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.698631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c9b5145b4a42da80df2106f049c65e', 'request_id': 'req-1eba8949-b211-40f6-ad9e-863a0eee22e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.700297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1039/2046] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:25.701166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.705897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c9b5145b4a42da80df2106f049c65e', 'request_id': 'req-1eba8949-b211-40f6-ad9e-863a0eee22e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.712225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7947b76-ffcd-4070-9a84-4bfd40699e16 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.717651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] The token cache is being invalidate because project a4c9b5145b4a42da80df2106f049c65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:25.718558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.718829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.720664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1008/2047] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:25 2022] DELETE /identity/v3/projects/a4c9b5145b4a42da80df2106f049c65e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:25.724419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.726712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.777719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.778419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.778686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.778956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.779637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.781580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.805027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1040/2048] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:25.806514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba8949-b211-40f6-ad9e-863a0eee22e7 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.809017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.810891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:25.812746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.813672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.813978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.814388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] PATH_INFO: `/v3/users/02659bb423434efc8a9224a27f3402e7` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.815745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02659bb423434efc8a9224a27f3402e7)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.819303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.826018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25367a6-39e0-468a-9e8d-643b89c8aca6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.832951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.834267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.834267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.834564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.835348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.837134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.848599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1041/2049] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:25.853354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.865589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8406ad-2675-4d6d-9312-16ab519b8d8f admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.871565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.872289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.872572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.872967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.873559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.875314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.878863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02659bb423434efc8a9224a27f3402e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.886309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02659bb423434efc8a9224a27f3402e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.890573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1042/2050] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:25.891465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:25.895646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02659bb423434efc8a9224a27f3402e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.896266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02659bb423434efc8a9224a27f3402e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.904154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2bd9-650c-4be6-8db8-c81aa766fa57 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:25.907840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aea9a915-123e-4a13-aa19-84df4a75ef1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02659bb423434efc8a9224a27f3402e7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:25.909638 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:25.911304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.911760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.912303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] PATH_INFO: `/v3/projects/f4e5995c47304182a7cb10c827e030b7/users/9d3fea140cc34e9bb3515876c9715d52/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:25.914503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1009/2051] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:25 2022] DELETE /identity/v3/users/02659bb423434efc8a9224a27f3402e7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:25.928766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e5995c47304182a7cb10c827e030b7, user_id=9d3fea140cc34e9bb3515876c9715d52, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:25.931975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:25.951139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1043/2052] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:25 2022] PUT /identity/v3/projects/f4e5995c47304182a7cb10c827e030b7/users/9d3fea140cc34e9bb3515876c9715d52/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:25.964880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:25.965172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:25.965442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.036702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] MFA Rules not processed for user `9d3fea140cc34e9bb3515876c9715d52`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:26.038325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:26.106176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1010/2053] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:26.117386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.119055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:26.175621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf2fa-a251-403a-a287-c3800a06d960 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.184363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9613d70-ca55-43c4-bfd4-7743bcd30025 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.184363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9613d70-ca55-43c4-bfd4-7743bcd30025 service glance] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.184363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9613d70-ca55-43c4-bfd4-7743bcd30025 service glance] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.184363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9613d70-ca55-43c4-bfd4-7743bcd30025 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.191162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9613d70-ca55-43c4-bfd4-7743bcd30025 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.193133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9613d70-ca55-43c4-bfd4-7743bcd30025 service glance] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.202400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1044/2054] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:26.209348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.210804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:26.282504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f260cfd-e8f0-4494-a31f-c951a5981716 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.288032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.288804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.289080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.289346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] PATH_INFO: `/v3/projects/a21e8e7c1a18465880d025d28b5213a4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.290546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21e8e7c1a18465880d025d28b5213a4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.292552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.347568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21e8e7c1a18465880d025d28b5213a4', 'request_id': 'req-2d034ee6-6d37-4457-a086-75ad06d5763c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:26.356501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21e8e7c1a18465880d025d28b5213a4', 'request_id': 'req-2d034ee6-6d37-4457-a086-75ad06d5763c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:26.362232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21e8e7c1a18465880d025d28b5213a4', 'request_id': 'req-2d034ee6-6d37-4457-a086-75ad06d5763c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:26.376735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] The token cache is being invalidate because project a21e8e7c1a18465880d025d28b5213a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:26.377035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:26.377777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-2d034ee6-6d37-4457-a086-75ad06d5763c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:26.379666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1011/2055] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:26 2022] DELETE /identity/v3/projects/a21e8e7c1a18465880d025d28b5213a4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:26.384465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.384752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.385030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.412471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:26.413907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:26.480348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1045/2056] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:26.488556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.488874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.489149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.507593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:26.508789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:26.517134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1012/2057] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:26.522070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.532308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb708f-e156-4c9c-b1c3-56afe7da236c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.538372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.539155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.539502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.539856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.540586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:26.540939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.542886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.555393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1046/2058] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:26.559962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.569828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966ffe5-0fc0-4ebb-a885-caf6069d1aee None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.574580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.575229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.575506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.575892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.576607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.578565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.606026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1013/2059] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:26 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:26.608875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.620347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a140e8-00a7-4828-aca8-b72b28ef1a67 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.701366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.702173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.702603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.703026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.704215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.706878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.731096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1047/2060] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:26 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:26.734958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.746338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ce1d-7c5e-486d-b28a-55b250db3be2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.751128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.751897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.752235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.752574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.753400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.755688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.768900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1014/2061] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:26.771098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.786770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2674a0a-6ef2-4bb8-aed0-d832a3377d85 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.791380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d86198-1228-40cf-b925-2b59723adabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.792041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d86198-1228-40cf-b925-2b59723adabd admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.792347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d86198-1228-40cf-b925-2b59723adabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.792752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d86198-1228-40cf-b925-2b59723adabd admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.793484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d86198-1228-40cf-b925-2b59723adabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.795219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d86198-1228-40cf-b925-2b59723adabd admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.805926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1048/2062] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:26.810102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.820507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59ad46-4cd8-43cd-ad5f-36a7383d2cca admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:26.825091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:26.826010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.826288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.826561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] PATH_INFO: `/v3/projects/5b1a4240183c4bb3a0767d61e9ec2091/users/53ecd21097684004a044fb9ea701ff53/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.841991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1a4240183c4bb3a0767d61e9ec2091, user_id=53ecd21097684004a044fb9ea701ff53, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:26.844776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:26.862943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1015/2063] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:26 2022] PUT /identity/v3/projects/5b1a4240183c4bb3a0767d61e9ec2091/users/53ecd21097684004a044fb9ea701ff53/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:26.874133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:26.874353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:26.874631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:26.901299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] MFA Rules not processed for user `53ecd21097684004a044fb9ea701ff53`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:26.902509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:26.964273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1049/2064] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:26.975358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:26.977298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:27.030270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e5c89-eaf8-437e-8e51-9876dfb211c8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:27.034082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f70ab-e438-4d7f-9e03-6e9cfd9674ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:27.034734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f70ab-e438-4d7f-9e03-6e9cfd9674ec service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:27.035014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f70ab-e438-4d7f-9e03-6e9cfd9674ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:27.035289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f70ab-e438-4d7f-9e03-6e9cfd9674ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:27.044466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f70ab-e438-4d7f-9e03-6e9cfd9674ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:27.045970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f70ab-e438-4d7f-9e03-6e9cfd9674ec service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:27.055304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1016/2065] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:29.405862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:29.408004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:29.488068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdebe7-ce1a-466a-b783-297d9c8a3ece None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:29.493844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:29.494722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:29.494998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:29.495266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] PATH_INFO: `/v3/users/7b7fc7d8f56d46dc8d018d2eeefb2237` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:29.496461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7fc7d8f56d46dc8d018d2eeefb2237)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:29.498449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:29.555252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7fc7d8f56d46dc8d018d2eeefb2237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:29.569541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7fc7d8f56d46dc8d018d2eeefb2237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:29.576261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7fc7d8f56d46dc8d018d2eeefb2237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:29.593296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7fc7d8f56d46dc8d018d2eeefb2237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:29.594209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7fc7d8f56d46dc8d018d2eeefb2237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:29.607026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1050/2066] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:29 2022] DELETE /identity/v3/users/7b7fc7d8f56d46dc8d018d2eeefb2237 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:29.609118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:29.609655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:29.609655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:29.628998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:29.630926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:29.718002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1017/2067] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:29.730955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:29.732823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:29.824047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f248-1143-42fb-9030-8c9bcc2946ff admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:29.829075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:29.830139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:29.830653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:29.831130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:29.844303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:29.846413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:29.861027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1051/2068] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:30.250163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.251688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:30.253249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.254884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:30.274912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ee8a4-81aa-44ce-b66d-368d615bdb66 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.277165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54fdc7-0113-4f29-95c3-5afd29bec2a2 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.280111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.281204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.281524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.281837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] PATH_INFO: `/v3/users/53ecd21097684004a044fb9ea701ff53` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.283121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ecd21097684004a044fb9ea701ff53)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.283748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.284858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.285184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.285290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.286125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] PATH_INFO: `/v3/projects/33cb10b718594b12aa46678a23900308` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.287574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cb10b718594b12aa46678a23900308)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.289800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.348667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ecd21097684004a044fb9ea701ff53'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.361189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cb10b718594b12aa46678a23900308', 'request_id': 'req-b2600d18-acb5-44f3-93f2-83b16b7be60e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.366211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ecd21097684004a044fb9ea701ff53'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.375550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cb10b718594b12aa46678a23900308', 'request_id': 'req-b2600d18-acb5-44f3-93f2-83b16b7be60e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.379187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ecd21097684004a044fb9ea701ff53'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.380544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ecd21097684004a044fb9ea701ff53'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.386499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cb10b718594b12aa46678a23900308', 'request_id': 'req-b2600d18-acb5-44f3-93f2-83b16b7be60e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.399057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-15d828ba-edbf-4dd7-948f-07db68debd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ecd21097684004a044fb9ea701ff53'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.399415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] The token cache is being invalidate because project 33cb10b718594b12aa46678a23900308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:30.400104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.400513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b2600d18-acb5-44f3-93f2-83b16b7be60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:30.402402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1052/2069] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:30 2022] DELETE /identity/v3/projects/33cb10b718594b12aa46678a23900308 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:30.411035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1018/2070] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:30 2022] DELETE /identity/v3/users/53ecd21097684004a044fb9ea701ff53 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:30.412411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.412411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.412411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.423425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c95a38-cdea-4728-9efa-0b4ed405e6ba None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.423722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c95a38-cdea-4728-9efa-0b4ed405e6ba None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.423998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c95a38-cdea-4728-9efa-0b4ed405e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.456425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:30.456657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-32c95a38-cdea-4728-9efa-0b4ed405e6ba None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:30.458411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:30.458750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-32c95a38-cdea-4728-9efa-0b4ed405e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:30.556818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1019/2071] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:30.559492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1053/2072] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:30.567363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.567652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.567925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.570003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.584628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:30.596627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:30.598660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:30.612541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1020/2073] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:30.614969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.624432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dcfe9-1035-415d-a09a-d291e9ea4e74 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.631207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.631880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.632158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.632851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.633218 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:30.633443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.635097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.654489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1021/2074] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:30.656227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.661177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbee919-347c-4198-aef8-a823855e29b9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.667114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.667925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.668411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.668759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.671625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56991a27-6331-44a7-9c84-44e700e6e1e7 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.677368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.678131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.678654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.678756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.679393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.681411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.682444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.684080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.695801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1054/2075] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:30.709904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1022/2076] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:30 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:30.713327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.722880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c51e3-5bb2-4110-8a83-f628f04a98d7 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.779948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.780768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.781044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.781313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.782059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.784095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.808350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1055/2077] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:30 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:30.809996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.821678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60b00-f81b-4f59-b281-175bc8fd2bca admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.826528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.827209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.827486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.827758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.828644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.831349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.842387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1023/2078] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:30.846576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.857519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55575471-897d-4d23-93b0-229587c31222 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.862657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e563f-97ac-4d8b-911d-df54daede174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.863319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e563f-97ac-4d8b-911d-df54daede174 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.863619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e563f-97ac-4d8b-911d-df54daede174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.864481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e563f-97ac-4d8b-911d-df54daede174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.865216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e563f-97ac-4d8b-911d-df54daede174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.866872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e563f-97ac-4d8b-911d-df54daede174 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.882146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1056/2079] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:30.883371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:30.893335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9f49-565c-4c3b-a2f3-2292ec2098ed admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:30.899696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:30.900691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.901034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.901391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] PATH_INFO: `/v3/projects/3b507c2836cd48e69837d0408f1af826/users/6febf66814d844e48db20e9f46567b05/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.916286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b507c2836cd48e69837d0408f1af826, user_id=6febf66814d844e48db20e9f46567b05, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:30.919106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:30.933029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1024/2080] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:30 2022] PUT /identity/v3/projects/3b507c2836cd48e69837d0408f1af826/users/6febf66814d844e48db20e9f46567b05/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:30.943522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:30.943803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:30.944075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:30.972551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] MFA Rules not processed for user `6febf66814d844e48db20e9f46567b05`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:30.974399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:31.095472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1057/2081] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:31.107636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.109402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:31.152657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.154235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:31.187153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057df4e6-d1f2-4cbc-af80-feb938e5feb8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.193990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a482803-f8cf-47e7-ab00-66b9952204d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.194712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482803-f8cf-47e7-ab00-66b9952204d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.195066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482803-f8cf-47e7-ab00-66b9952204d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.195404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482803-f8cf-47e7-ab00-66b9952204d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.205269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a482803-f8cf-47e7-ab00-66b9952204d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.207852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a482803-f8cf-47e7-ab00-66b9952204d9 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.218002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1025/2082] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:31.234421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f0f1a-0623-41b8-8a54-fc7e636f1962 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.239353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.240285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.240626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.240960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] PATH_INFO: `/v3/projects/5b1a4240183c4bb3a0767d61e9ec2091` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.242269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1a4240183c4bb3a0767d61e9ec2091)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.244256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.300985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1a4240183c4bb3a0767d61e9ec2091', 'request_id': 'req-4d298835-31ce-40b5-897d-6bb34f5bb555'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:31.310144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1a4240183c4bb3a0767d61e9ec2091', 'request_id': 'req-4d298835-31ce-40b5-897d-6bb34f5bb555'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:31.316586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1a4240183c4bb3a0767d61e9ec2091', 'request_id': 'req-4d298835-31ce-40b5-897d-6bb34f5bb555'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:31.338010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] The token cache is being invalidate because project 5b1a4240183c4bb3a0767d61e9ec2091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:31.338304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:31.339012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-4d298835-31ce-40b5-897d-6bb34f5bb555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:31.341103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1058/2083] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:31 2022] DELETE /identity/v3/projects/5b1a4240183c4bb3a0767d61e9ec2091 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:31.346175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.346850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.347125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.367832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:31.369122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:31.442298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1026/2084] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:31.444136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.444657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.444749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.477451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:31.479192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:31.489626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1059/2085] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:31.493952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.521046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334f98c-16c0-4b1e-ad07-25054ac4ff05 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.526684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.527581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.528004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.528442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.529873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:31.530396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.532235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.555848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1027/2086] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:31.559965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.572308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4adcbc-6c4c-44d4-9e7a-264971ee0839 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.583470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.584516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.584870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.585214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.586733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.590379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.633790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1060/2087] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:31 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:31.637226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.657434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd2a85-9526-4f15-887e-772dd06b5fe8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.731431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.732332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.732824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.733257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.734134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.736539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.774932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1028/2088] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:31 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:31.775754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.790876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b12b8-ff7f-48ff-a1e8-b31553c072e5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.806063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.806063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.806063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.806063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.806401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.806401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.815463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1061/2089] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:31.820058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.829758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7aec4-c9ac-4b15-9bc3-c60256be3ec0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.834432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712737bb-6bb4-423c-b1d7-4e803acb935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.835080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712737bb-6bb4-423c-b1d7-4e803acb935d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.835359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712737bb-6bb4-423c-b1d7-4e803acb935d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.835633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712737bb-6bb4-423c-b1d7-4e803acb935d admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.836351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712737bb-6bb4-423c-b1d7-4e803acb935d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.838001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712737bb-6bb4-423c-b1d7-4e803acb935d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.847753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1029/2090] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:31.852055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:31.862797 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423b6b-5ce1-49e4-83c1-5d47c9b2930d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:31.867955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:31.868831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.869103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.869372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] PATH_INFO: `/v3/projects/a54e0dd7ccff4bbeb676763e4306e89a/users/109b308a10334c6dbce6aab21d479f11/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.885414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54e0dd7ccff4bbeb676763e4306e89a, user_id=109b308a10334c6dbce6aab21d479f11, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:31.888098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:31.901339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1062/2091] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:31 2022] PUT /identity/v3/projects/a54e0dd7ccff4bbeb676763e4306e89a/users/109b308a10334c6dbce6aab21d479f11/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:31.911843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:31.912137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:31.912421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:31.938656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] MFA Rules not processed for user `109b308a10334c6dbce6aab21d479f11`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:31.939707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:32.008143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1030/2092] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:32.020268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:32.022013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:32.080715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fd91-beba-40db-8719-e543369c17b6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:32.085450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103952-ebcc-416b-8241-980ab0f2ca9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:32.086454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103952-ebcc-416b-8241-980ab0f2ca9b service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:32.086561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103952-ebcc-416b-8241-980ab0f2ca9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:32.086773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103952-ebcc-416b-8241-980ab0f2ca9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:32.095742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103952-ebcc-416b-8241-980ab0f2ca9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:32.097208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0103952-ebcc-416b-8241-980ab0f2ca9b service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:32.106894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1063/2093] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:44.275751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:44.356253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de5b97-dec5-4a21-be3d-dd8b75148aa9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:44.361386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:44.362569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:44.362956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:44.363909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] PATH_INFO: `/v3/users/109b308a10334c6dbce6aab21d479f11` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:44.365322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=109b308a10334c6dbce6aab21d479f11)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:44.367827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:44.434988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109b308a10334c6dbce6aab21d479f11'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:44.443356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109b308a10334c6dbce6aab21d479f11'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:44.451354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109b308a10334c6dbce6aab21d479f11'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:44.452208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109b308a10334c6dbce6aab21d479f11'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:44.464468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109b308a10334c6dbce6aab21d479f11'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:44.470796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1031/2094] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:44 2022] DELETE /identity/v3/users/109b308a10334c6dbce6aab21d479f11 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:44.476185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:44.476711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:44.476711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:44.496475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:44.497830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:44.568927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1064/2095] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:44.581795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:44.583281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:44.661231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776a4aa-7167-48fc-9af4-dbeef79ebb6e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:44.665826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502db8a9-6f98-44ec-8868-8f09358bf00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:44.666603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502db8a9-6f98-44ec-8868-8f09358bf00a service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:44.666977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502db8a9-6f98-44ec-8868-8f09358bf00a service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:44.667390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502db8a9-6f98-44ec-8868-8f09358bf00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:44.682062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502db8a9-6f98-44ec-8868-8f09358bf00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:44.683731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502db8a9-6f98-44ec-8868-8f09358bf00a service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:44.696545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1032/2096] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:45.003207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.005152 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:45.029273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b91fc-292d-42de-95a5-efaaaac31bdd None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.047114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.048043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.048466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.048685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] PATH_INFO: `/v3/projects/a54e0dd7ccff4bbeb676763e4306e89a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.050478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54e0dd7ccff4bbeb676763e4306e89a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.053234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.170213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54e0dd7ccff4bbeb676763e4306e89a', 'request_id': 'req-f8ee1fa8-eba8-487c-b86c-191384f08fa6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:45.180748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54e0dd7ccff4bbeb676763e4306e89a', 'request_id': 'req-f8ee1fa8-eba8-487c-b86c-191384f08fa6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:45.196274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54e0dd7ccff4bbeb676763e4306e89a', 'request_id': 'req-f8ee1fa8-eba8-487c-b86c-191384f08fa6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:45.219090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] The token cache is being invalidate because project a54e0dd7ccff4bbeb676763e4306e89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:45.219681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:45.220417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f8ee1fa8-eba8-487c-b86c-191384f08fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:45.223059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1065/2097] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:45 2022] DELETE /identity/v3/projects/a54e0dd7ccff4bbeb676763e4306e89a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:45.228019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.228409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.228575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.248524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:45.248524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:45.323251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.323536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.323810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.326518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1033/2098] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:45.344597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:45.345958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:45.358241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1066/2099] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:45.360070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.370687 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4edcfc-9049-4bf8-86d3-9177abbf4ce3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.381613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.382964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.383496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.383974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.384927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:45.385445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.387791 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.402142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1034/2100] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:45.406485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.418639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e584935-82d8-40b9-abdd-6de2f9ba1eca None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.424295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.425063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.425349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.426225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.427474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.429004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.459820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1067/2101] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:45 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:45.464028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.474891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865e310-1190-4ec4-89b5-7ae7a1501a71 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.541764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.542661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.542894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.543190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.543894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.545841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.574346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1035/2102] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:45 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:45.575866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.587567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a015a-7b9d-45f9-83f9-940d1e9794cf admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.593229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.593933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.594212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.594483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.595264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.596900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.609153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1068/2103] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:45.612988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.624133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc3d0-f2b5-4782-95b6-2db50ed3411b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.628970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3285d1-bdff-4370-965b-93b13a089670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.629660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3285d1-bdff-4370-965b-93b13a089670 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.630010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3285d1-bdff-4370-965b-93b13a089670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.630246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3285d1-bdff-4370-965b-93b13a089670 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.631100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3285d1-bdff-4370-965b-93b13a089670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.632750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3285d1-bdff-4370-965b-93b13a089670 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.645682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1036/2104] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:45.647397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.657349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fa91-31f4-44c9-879d-5a283a093cfa admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.663099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.663981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.664261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.664534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] PATH_INFO: `/v3/projects/55fbe5576de844559b26175408f40f3f/users/e0f8b3570fb544c7be48b4bc3401e780/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.680171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fbe5576de844559b26175408f40f3f, user_id=e0f8b3570fb544c7be48b4bc3401e780, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.683410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.699655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1069/2105] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:45 2022] PUT /identity/v3/projects/55fbe5576de844559b26175408f40f3f/users/e0f8b3570fb544c7be48b4bc3401e780/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:45.705043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.705256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.705526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.730449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:45.731641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:45.802919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1037/2106] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:45.822217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:45.823997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:45.894199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6f283-0b91-46fb-af23-81c41c5772b0 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:45.898546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8581c5e-199f-4cdc-852c-365a23932616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:45.899197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8581c5e-199f-4cdc-852c-365a23932616 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:45.899475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8581c5e-199f-4cdc-852c-365a23932616 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:45.899775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8581c5e-199f-4cdc-852c-365a23932616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:45.915095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8581c5e-199f-4cdc-852c-365a23932616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:45.915095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8581c5e-199f-4cdc-852c-365a23932616 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:45.922229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1070/2107] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:46.661076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:46.663166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:46.678267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0cac2-9fb8-420a-a70a-ffdc537e38cc None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:46.683741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:46.684894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:46.685312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:46.685814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] PATH_INFO: `/v3/users/362a913efc5b49a88401085e6fda9ae7` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:46.688179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] RBAC: Authorizing `identity:delete_user(user_id=362a913efc5b49a88401085e6fda9ae7)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:46.690902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:46.788425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '362a913efc5b49a88401085e6fda9ae7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:46.801200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '362a913efc5b49a88401085e6fda9ae7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:46.832914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '362a913efc5b49a88401085e6fda9ae7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:46.833641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '362a913efc5b49a88401085e6fda9ae7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:46.867960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '362a913efc5b49a88401085e6fda9ae7'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:46.874788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1038/2108] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:46 2022] DELETE /identity/v3/users/362a913efc5b49a88401085e6fda9ae7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:46.888410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:46.888410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:46.888410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:46.905231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:46.906491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:46.969241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1071/2109] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:46.979478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:46.981077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:47.052959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a7492-ea88-4868-8da3-d81462e3237c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:47.058273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:47.059177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:47.059589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:47.059961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:47.074939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:47.077525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:47.105948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1039/2110] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:47.430561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:47.436540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:47.468581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fb3c8-ee4c-4261-83c2-5ddaeb175cec None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:47.480183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:47.481327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:47.481460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:47.481840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] PATH_INFO: `/v3/projects/57794cd036cf4c3fb80f2114caed1c6f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:47.485161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57794cd036cf4c3fb80f2114caed1c6f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:47.487261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:47.554748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57794cd036cf4c3fb80f2114caed1c6f', 'request_id': 'req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.564259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57794cd036cf4c3fb80f2114caed1c6f', 'request_id': 'req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.570825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57794cd036cf4c3fb80f2114caed1c6f', 'request_id': 'req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.585831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] The token cache is being invalidate because project 57794cd036cf4c3fb80f2114caed1c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:47.586196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.586964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.588949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1072/2111] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:47 2022] DELETE /identity/v3/projects/57794cd036cf4c3fb80f2114caed1c6f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:47.592855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:47.604041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed353be8-65cd-417f-aa01-68e0285ce01a service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:47.671930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:47.672930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:47.673269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:47.673604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] PATH_INFO: `/v3/users/a8534c727efb4f31989e0aae743d7a5f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:47.675031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8534c727efb4f31989e0aae743d7a5f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:47.677697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:47.781071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8534c727efb4f31989e0aae743d7a5f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.790837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8534c727efb4f31989e0aae743d7a5f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.803604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8534c727efb4f31989e0aae743d7a5f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.804383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8534c727efb4f31989e0aae743d7a5f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.817535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ec239c88-31fc-475a-8c0b-645a6d615fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8534c727efb4f31989e0aae743d7a5f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:47.826150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1040/2112] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:47 2022] DELETE /identity/v3/users/a8534c727efb4f31989e0aae743d7a5f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:48.139084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.140640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:48.156155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4d09f-23c0-4db4-9555-0d6f8ba2ff51 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.223125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.224112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.224463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.224830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] PATH_INFO: `/v3/projects/b5a1e7033f924fa4a44c2d93fdf1735e` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.226420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a1e7033f924fa4a44c2d93fdf1735e)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.229096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.283293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a1e7033f924fa4a44c2d93fdf1735e', 'request_id': 'req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.298636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a1e7033f924fa4a44c2d93fdf1735e', 'request_id': 'req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.307634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a1e7033f924fa4a44c2d93fdf1735e', 'request_id': 'req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.323040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] The token cache is being invalidate because project b5a1e7033f924fa4a44c2d93fdf1735e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:48.323432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.324669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dcedc149-d4ed-44c0-8d5c-cbd0cb616a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.332470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1073/2113] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:48 2022] DELETE /identity/v3/projects/b5a1e7033f924fa4a44c2d93fdf1735e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:48.334652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.335227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.336073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.356391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:48.357680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:48.430688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1041/2114] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:48.438889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.439071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.439442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.461641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:48.463654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:48.479844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1074/2115] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:48.484425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.494784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3d4db-3043-481a-875e-a0b3908c6fe7 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.499841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.500502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.500781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.501054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.501876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:48.502192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.503853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.515899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1042/2116] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:57:48.522443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.523476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.527741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:48.537770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420fd5e-6ebc-467d-b0db-d9af9e2ea27e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.549592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b135011-6cbf-499e-b217-c077294f5c75 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.554463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.555196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.555963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.555963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.556692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.558666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.559672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.560636 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.561633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.561967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] PATH_INFO: `/v3/users/0cfe14bbc5f34432882bf74de0536ab4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.565283 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfe14bbc5f34432882bf74de0536ab4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.568508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.616506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1075/2117] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:48 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:48.620889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.641173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfe14bbc5f34432882bf74de0536ab4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.649494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfe14bbc5f34432882bf74de0536ab4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.663688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfe14bbc5f34432882bf74de0536ab4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.664708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfe14bbc5f34432882bf74de0536ab4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.680320 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfe14bbc5f34432882bf74de0536ab4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:48.689496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1043/2118] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:57:48 2022] DELETE /identity/v3/users/0cfe14bbc5f34432882bf74de0536ab4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:57:48.697007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42a19d-9dd7-4adb-9b6f-4d714e9563d0 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.760435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.761493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.761991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.762458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.763340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.765946 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.795600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1076/2119] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:48 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:48.799876 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.801944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:48.815997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a21b95-a060-4cba-b369-38e2f81bb4d3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.822073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.823050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.823536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.824027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.824976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.827028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.841102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1044/2120] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:48.844766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.863838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d93e61-eed6-42f1-9e12-024ea774a140 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.871743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.874018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.874545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.875035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.875906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.878083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.896821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1077/2121] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:48.902137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.913652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706014d5-1370-4621-8379-7f3d44d81c8a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:48.920621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8fcab-f988-45bd-9925-2e365db04455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:48.921593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8fcab-f988-45bd-9925-2e365db04455 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:48.922011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8fcab-f988-45bd-9925-2e365db04455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:48.922472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8fcab-f988-45bd-9925-2e365db04455 admin admin] PATH_INFO: `/v3/projects/a34eae2bb5b74befb1c7bf44f013a54e/users/38df0699a7014f81b10b5f5fff0a99ed/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:48.956510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8fcab-f988-45bd-9925-2e365db04455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34eae2bb5b74befb1c7bf44f013a54e, user_id=38df0699a7014f81b10b5f5fff0a99ed, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:48.960237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8fcab-f988-45bd-9925-2e365db04455 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:48.983555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:48.986846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:48.992725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1045/2122] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:48 2022] PUT /identity/v3/projects/a34eae2bb5b74befb1c7bf44f013a54e/users/38df0699a7014f81b10b5f5fff0a99ed/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:49.008762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.009520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.009895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.021002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226a16-1eea-43e6-89d0-eb78259723b5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.067558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] MFA Rules not processed for user `38df0699a7014f81b10b5f5fff0a99ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:49.069343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:49.145789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.146668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.147151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.147587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] PATH_INFO: `/v3/projects/a145ae754d55458792b86bdda0ceb304` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.148950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a145ae754d55458792b86bdda0ceb304)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.151510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.181563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1046/2123] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:49.185846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.208247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4681386-347d-48fa-96fd-1c48088ae8b2 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.219896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a145ae754d55458792b86bdda0ceb304', 'request_id': 'req-8fdeb396-f30c-4573-8285-55d819fd136e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:49.238103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a145ae754d55458792b86bdda0ceb304', 'request_id': 'req-8fdeb396-f30c-4573-8285-55d819fd136e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:49.246510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a145ae754d55458792b86bdda0ceb304', 'request_id': 'req-8fdeb396-f30c-4573-8285-55d819fd136e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:49.264706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] The token cache is being invalidate because project a145ae754d55458792b86bdda0ceb304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:57:49.265196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:49.282682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8fdeb396-f30c-4573-8285-55d819fd136e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:57:49.290510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1078/2124] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:57:48 2022] DELETE /identity/v3/projects/a145ae754d55458792b86bdda0ceb304 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:49.298176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52357f64-2e4f-46fb-8fa1-b1241b71b032 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.298557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52357f64-2e4f-46fb-8fa1-b1241b71b032 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.298903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52357f64-2e4f-46fb-8fa1-b1241b71b032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.324625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-52357f64-2e4f-46fb-8fa1-b1241b71b032 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:49.325941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-52357f64-2e4f-46fb-8fa1-b1241b71b032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:49.332786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.333461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.333764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.334035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.334729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.336684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.338437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1079/2125] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:49.345847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.346611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.346902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.373322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:49.375068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:49.390990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1080/2126] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:49.391872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1047/2127] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:57:49.392761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.393166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.395164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:49.406308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826eebf-7950-4d46-9ad2-c8ff1caa3c52 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.484658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e77dc-6e93-47ea-b626-1acc3bb9f9f2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.490265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.491118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.491406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.491880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.492589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.495229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.503135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.504893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.505513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.506044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.507236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:57:49.507749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.510989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.527175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1048/2128] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:49.533298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.544997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1081/2129] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:57:49.547556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d38d8-f780-4ab5-a769-2345dd4feccf admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.549292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.559268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.560106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.560463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.560807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.560992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926774b-1b1d-416e-8804-1b9381fd98eb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.562293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.565221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.573787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.573787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.573787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.573787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.574156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.575764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.579265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1049/2130] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:49.587138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.603399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46705a2-dc33-4020-a17d-52a5cbe5d215 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.611104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.614041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.614911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.614911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] PATH_INFO: `/v3/projects/be1c028ab10144d4b18d991036003c75/users/987203d0b3c34e91af9c7c33f3e5c066/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.629887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1082/2131] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:49.632922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.637890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1c028ab10144d4b18d991036003c75, user_id=987203d0b3c34e91af9c7c33f3e5c066, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.641640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.663272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1050/2132] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:49 2022] PUT /identity/v3/projects/be1c028ab10144d4b18d991036003c75/users/987203d0b3c34e91af9c7c33f3e5c066/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:49.664979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.712554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a902a0-95e2-43b2-8b88-f3f1fdc73cab admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.737885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142231-fea1-4875-9280-98b8efcd1213 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.743121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.743877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.744250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.744520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.745259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.746984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.760912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1051/2133] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:49.762174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.775172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e09ea-1e38-4ce5-8f44-024694ea8993 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.789408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7affd7-3558-49f1-8c1c-d7d2756cd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.790430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7affd7-3558-49f1-8c1c-d7d2756cd9db admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.790714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7affd7-3558-49f1-8c1c-d7d2756cd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.790991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7affd7-3558-49f1-8c1c-d7d2756cd9db admin admin] PATH_INFO: `/v3/projects/be1c028ab10144d4b18d991036003c75/users/987203d0b3c34e91af9c7c33f3e5c066/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.793769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.794893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.794893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.795425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.795889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7affd7-3558-49f1-8c1c-d7d2756cd9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1c028ab10144d4b18d991036003c75, user_id=987203d0b3c34e91af9c7c33f3e5c066, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.796268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.798668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.798797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7affd7-3558-49f1-8c1c-d7d2756cd9db admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.820195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1052/2134] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:49 2022] PUT /identity/v3/projects/be1c028ab10144d4b18d991036003c75/users/987203d0b3c34e91af9c7c33f3e5c066/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:49.832824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1083/2135] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:49.835492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.835789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.836069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.838241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.853630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e580e-29f9-49d8-8399-67d2c6d1a777 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.884597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] MFA Rules not processed for user `987203d0b3c34e91af9c7c33f3e5c066`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:49.886537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:49.923158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.923840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.924712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.925224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.926466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.928748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.946114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1084/2136] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:49.947804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.962083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245cc42-c0de-4695-9e48-0ff8d1d99c60 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:49.968048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:49.968942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:49.969323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:49.969840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:49.970630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:49.973027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:49.985512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1053/2137] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:57:49.990988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1085/2138] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:49.991412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:49.999605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:50.001778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:50.006137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ade1f-15f4-4ce1-a92e-a2fd35226bc9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:50.011590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e4721-5743-4afb-a8c6-9f0113b107c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:50.012871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e4721-5743-4afb-a8c6-9f0113b107c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:50.013222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e4721-5743-4afb-a8c6-9f0113b107c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:50.013640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e4721-5743-4afb-a8c6-9f0113b107c1 admin admin] PATH_INFO: `/v3/projects/d288b61a6379415c9f773fc61950f570/users/673ff42fb9454adf93be94f46e60755a/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:50.057935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e4721-5743-4afb-a8c6-9f0113b107c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d288b61a6379415c9f773fc61950f570, user_id=673ff42fb9454adf93be94f46e60755a, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:50.060835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e4721-5743-4afb-a8c6-9f0113b107c1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:50.080482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1054/2139] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:49 2022] PUT /identity/v3/projects/d288b61a6379415c9f773fc61950f570/users/673ff42fb9454adf93be94f46e60755a/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:50.089051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:50.090194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:50.091426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:50.122727 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:50.124061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407aacd-48c1-41d5-ac50-2d8359dc536a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:50.126011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:50.176199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:50.176982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:50.177328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:50.177690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:50.180040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:50.203133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1055/2140] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:50.215470 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:50.217649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:50.298830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:50.300791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545fd12-701a-4525-980a-3582223d4cbf service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:50.315380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1086/2141] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:50.357684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efc63f-29b0-4576-9e32-9a19deb86520 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:50.370358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:50.371035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:50.371438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:50.371751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:50.411617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:50.413550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:50.434438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1056/2142] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:57:51.337381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:51.337987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:51.337987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:51.382749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] MFA Rules not processed for user `e0f8b3570fb544c7be48b4bc3401e780`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:51.383889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:51.502096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:51.503617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:51.505890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1087/2143] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:51.535845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cfb82-aae0-4295-8207-37455fb3c7a9 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:51.555309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:51.556231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:51.557256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:51.557829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:51.558738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:51.563350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:51.609966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1057/2144] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:57:51 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:51.613678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:51.626890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddc8d7-5379-4c47-a9d8-339f3ba8fa5a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:51.744663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:51.745829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:51.746276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:51.747254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:51.750001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:51.753304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:51.789588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1088/2145] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:57:51 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:57:51.795006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:51.826424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539f6c8-2df7-4e69-a86c-338c6b93d9ea admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:51.837096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:51.838734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:51.838734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:51.838734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:51.839499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:51.841688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:51.870231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1058/2146] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:57:51.873462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:51.914029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a184-c94c-4995-b76f-ce02ead14fe3 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:51.927503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:51.928645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:51.929092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:51.929529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] PATH_INFO: `/v3/projects/4054a926c7484734914d42c8f7f48991/users/ea822aca1f9d4ddaa081a86b2e9403c4/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:51.955812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4054a926c7484734914d42c8f7f48991, user_id=ea822aca1f9d4ddaa081a86b2e9403c4, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:51.961178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:51.986244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:51.986694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1089/2147] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:51 2022] PUT /identity/v3/projects/4054a926c7484734914d42c8f7f48991/users/ea822aca1f9d4ddaa081a86b2e9403c4/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:52.000215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302435bf-7eba-4036-9b2f-f7da1962c8f8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:52.093832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:52.094754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:52.094867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:52.095248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:52.096062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:52.097922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:52.126538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1059/2148] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:57:52.130805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:52.143646 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558eccd2-dd12-4784-89a9-c1d76e2641e6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:52.149194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e00ce-0596-4a72-be42-0b076c9652d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:52.150626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e00ce-0596-4a72-be42-0b076c9652d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:52.150913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e00ce-0596-4a72-be42-0b076c9652d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:52.151190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e00ce-0596-4a72-be42-0b076c9652d2 admin admin] PATH_INFO: `/v3/projects/4054a926c7484734914d42c8f7f48991/users/ea822aca1f9d4ddaa081a86b2e9403c4/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:52.153199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e00ce-0596-4a72-be42-0b076c9652d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4054a926c7484734914d42c8f7f48991, user_id=ea822aca1f9d4ddaa081a86b2e9403c4, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:52.156437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e00ce-0596-4a72-be42-0b076c9652d2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:52.176489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1090/2149] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:57:52 2022] PUT /identity/v3/projects/4054a926c7484734914d42c8f7f48991/users/ea822aca1f9d4ddaa081a86b2e9403c4/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:57:55.249219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:55.251041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:55.377556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71fd87-1e0a-4875-8f9e-3f7ba87450f9 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:55.477382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b910c0-5e82-43a0-a73a-7e34a06cbb16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:55.478286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b910c0-5e82-43a0-a73a-7e34a06cbb16 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:55.478611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b910c0-5e82-43a0-a73a-7e34a06cbb16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:55.478974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b910c0-5e82-43a0-a73a-7e34a06cbb16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:55.653826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b910c0-5e82-43a0-a73a-7e34a06cbb16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:55.653826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b910c0-5e82-43a0-a73a-7e34a06cbb16 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:55.682017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1060/2150] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:56.971216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:56.971784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:56.972835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:57.031689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] MFA Rules not processed for user `673ff42fb9454adf93be94f46e60755a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:57.033827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:57.143459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1091/2151] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:57.154087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761619-37b6-49c5-b75a-e06abd162951 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:57.154661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761619-37b6-49c5-b75a-e06abd162951 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:57.154661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761619-37b6-49c5-b75a-e06abd162951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:57.173605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c5761619-37b6-49c5-b75a-e06abd162951 None None] MFA Rules not processed for user `673ff42fb9454adf93be94f46e60755a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:57.175752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c5761619-37b6-49c5-b75a-e06abd162951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:57.185163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1061/2152] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:57.198221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:57.199938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:57.333462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596f60d-80ae-41fb-bd8a-3c9c3b8d766c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:57.340991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f032c6-dd35-405a-93ff-780b73a87612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:57.341662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f032c6-dd35-405a-93ff-780b73a87612 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:57.341984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f032c6-dd35-405a-93ff-780b73a87612 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:57.342261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f032c6-dd35-405a-93ff-780b73a87612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:57.351531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f032c6-dd35-405a-93ff-780b73a87612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:57.353240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f032c6-dd35-405a-93ff-780b73a87612 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:57.398457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1092/2153] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:57:58.748350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:58.748845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:58.748938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:58.797585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] MFA Rules not processed for user `673ff42fb9454adf93be94f46e60755a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:58.799206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:58.809260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1062/2154] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:59.100619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f152-42b9-488a-a6ec-cf29b0ba6dfb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:59.101504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f152-42b9-488a-a6ec-cf29b0ba6dfb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:59.101965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0f152-42b9-488a-a6ec-cf29b0ba6dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:59.163059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-64a0f152-42b9-488a-a6ec-cf29b0ba6dfb None None] MFA Rules not processed for user `ea822aca1f9d4ddaa081a86b2e9403c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:57:59.167046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-64a0f152-42b9-488a-a6ec-cf29b0ba6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:59.337265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1093/2155] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:57:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:57:59.353596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:57:59.355641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:57:59.410402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e201834-fdc0-4c97-b667-d04cdb764859 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:57:59.462254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:57:59.463982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:57:59.464450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:57:59.464728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:57:59.571092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:57:59.572917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:57:59.599653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1063/2156] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:57:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:02.055612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0206-c257-43e2-974a-d3304378d7ae None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:02.056705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0206-c257-43e2-974a-d3304378d7ae None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:02.057207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b0206-c257-43e2-974a-d3304378d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:02.080756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b57b0206-c257-43e2-974a-d3304378d7ae None None] MFA Rules not processed for user `e0f8b3570fb544c7be48b4bc3401e780`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:02.083605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b57b0206-c257-43e2-974a-d3304378d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:02.101194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1094/2157] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:05.241481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:05.443855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470bcc3-7f47-4406-949a-f8ed08015ffd service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:05.458656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:05.462564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:05.462994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:05.463518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] PATH_INFO: `/v3/users/38df0699a7014f81b10b5f5fff0a99ed` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:05.465003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38df0699a7014f81b10b5f5fff0a99ed)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:05.481296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:05.579572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38df0699a7014f81b10b5f5fff0a99ed'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:05.588908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38df0699a7014f81b10b5f5fff0a99ed'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:05.599563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38df0699a7014f81b10b5f5fff0a99ed'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:05.600564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38df0699a7014f81b10b5f5fff0a99ed'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:05.616333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38df0699a7014f81b10b5f5fff0a99ed'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:05.622356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1064/2158] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:05 2022] DELETE /identity/v3/users/38df0699a7014f81b10b5f5fff0a99ed => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:58:05.626983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:05.627471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:05.627579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:05.645627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:05.646851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:05.703281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1095/2159] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:05.714171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:05.715730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:05.775213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9103a-124c-4849-8b6b-ef453c0ae110 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:05.779177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:05.779816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:05.780092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:05.780359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:05.791395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:05.792430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:05.804260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1065/2160] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:06.083157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:06.087079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:06.100944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c15ef-faa1-45ce-9a64-b004299d29ba None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:06.106319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:06.107173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.107600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.108042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] PATH_INFO: `/v3/projects/a34eae2bb5b74befb1c7bf44f013a54e` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.109711 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34eae2bb5b74befb1c7bf44f013a54e)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:06.111902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:06.155796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34eae2bb5b74befb1c7bf44f013a54e', 'request_id': 'req-bd5111c7-1525-42ee-8804-0fbb9907a866'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.163365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34eae2bb5b74befb1c7bf44f013a54e', 'request_id': 'req-bd5111c7-1525-42ee-8804-0fbb9907a866'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.168840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34eae2bb5b74befb1c7bf44f013a54e', 'request_id': 'req-bd5111c7-1525-42ee-8804-0fbb9907a866'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.180905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] The token cache is being invalidate because project a34eae2bb5b74befb1c7bf44f013a54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:06.181193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.181885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.183448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1096/2161] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:06 2022] DELETE /identity/v3/projects/a34eae2bb5b74befb1c7bf44f013a54e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:06.187415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:06.196892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf9d2-139f-4a22-8234-4c843eff8417 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:06.251086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:06.251962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.252241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.252512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] PATH_INFO: `/v3/users/987203d0b3c34e91af9c7c33f3e5c066` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.253886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987203d0b3c34e91af9c7c33f3e5c066)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:06.255804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:06.300735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987203d0b3c34e91af9c7c33f3e5c066'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.310565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987203d0b3c34e91af9c7c33f3e5c066'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.315264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987203d0b3c34e91af9c7c33f3e5c066'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.316543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987203d0b3c34e91af9c7c33f3e5c066'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.328279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4342e608-4344-48d8-8b74-a1ffbe890522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987203d0b3c34e91af9c7c33f3e5c066'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.334121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1066/2162] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:06 2022] DELETE /identity/v3/users/987203d0b3c34e91af9c7c33f3e5c066 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:06.628480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:06.629985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:06.647822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5111c7-1525-42ee-8804-0fbb9907a866 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:06.720106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:06.721019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.721299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.721568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] PATH_INFO: `/v3/projects/be1c028ab10144d4b18d991036003c75` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.723326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1c028ab10144d4b18d991036003c75)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:06.725538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:06.773196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1c028ab10144d4b18d991036003c75', 'request_id': 'req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.781202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1c028ab10144d4b18d991036003c75', 'request_id': 'req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.787502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1c028ab10144d4b18d991036003c75', 'request_id': 'req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.798623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] The token cache is being invalidate because project be1c028ab10144d4b18d991036003c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:06.798911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.799556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-84de2bf5-8bd0-4060-bf42-7c25e9be4e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:06.801171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1097/2163] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:06 2022] DELETE /identity/v3/projects/be1c028ab10144d4b18d991036003c75 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:06.807083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc938a-f3df-4059-848c-37407d576608 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.807381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc938a-f3df-4059-848c-37407d576608 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.807660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc938a-f3df-4059-848c-37407d576608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.826841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-85fc938a-f3df-4059-848c-37407d576608 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:06.827924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-85fc938a-f3df-4059-848c-37407d576608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:06.887750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1067/2164] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:06.897513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.897829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.898106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.924221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:06.926302 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:06.938897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1098/2165] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:06.941677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc938a-f3df-4059-848c-37407d576608 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:06.955460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc938a-f3df-4059-848c-37407d576608 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:06.961137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:06.961836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.962118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.962388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.963116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:58:06.963422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:06.965037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:06.977985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1068/2166] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:58:06.982514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:06.992089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7ca7e-3e55-4e2d-8204-4d1d60542633 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:06.996717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:06.997355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:06.997630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:06.997930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:06.998644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:07.000683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:07.030844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1099/2167] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:07.035725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:07.048342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf3f7a-01c8-49c8-8cf4-ea4912d329e5 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:07.113379 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:07.114095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:07.114375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:07.114652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:07.115336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:07.117260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:07.140721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1069/2168] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:58:07 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:58:07.145233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:07.156676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed48bf-7005-4455-868f-df7f0cf5585d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:07.161516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:07.162226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:07.162508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:07.162783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:07.163513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:07.165127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:07.175968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1100/2169] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:58:07.180037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:07.189842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8575-931f-4968-a8d0-e6cafeaaa5fd admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:07.194921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0d62b-a892-4eaa-bd13-ce41610547ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:07.195559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d62b-a892-4eaa-bd13-ce41610547ca admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:07.195833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d62b-a892-4eaa-bd13-ce41610547ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:07.196100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0d62b-a892-4eaa-bd13-ce41610547ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:07.196956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0d62b-a892-4eaa-bd13-ce41610547ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:07.198579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0d62b-a892-4eaa-bd13-ce41610547ca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:07.208049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1070/2170] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:58:07.211950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:07.222271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb20488-4b15-4f31-b733-ed4faede9c41 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:07.227493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:07.228376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:07.228652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:07.228925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] PATH_INFO: `/v3/projects/f4b3a6d2500042178a16153b1ad589d3/users/d01273c4526f41e6abb63cd4a4493d06/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:07.243627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b3a6d2500042178a16153b1ad589d3, user_id=d01273c4526f41e6abb63cd4a4493d06, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:07.246317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:07.258991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1101/2171] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:58:07 2022] PUT /identity/v3/projects/f4b3a6d2500042178a16153b1ad589d3/users/d01273c4526f41e6abb63cd4a4493d06/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:07.270194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:07.270670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:07.270788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:07.295615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] MFA Rules not processed for user `d01273c4526f41e6abb63cd4a4493d06`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:07.296881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:07.368272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1071/2172] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:58:07.379360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:07.381019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:07.439276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19bd2a-b780-427d-bf56-25c332a10107 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:07.442897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9de4d5-d4d6-4cfc-a431-150874327178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:07.443525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9de4d5-d4d6-4cfc-a431-150874327178 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:07.443800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9de4d5-d4d6-4cfc-a431-150874327178 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:07.444066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9de4d5-d4d6-4cfc-a431-150874327178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:07.452099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9de4d5-d4d6-4cfc-a431-150874327178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:07.453522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9de4d5-d4d6-4cfc-a431-150874327178 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:07.462015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1102/2173] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:16.922982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:16.985958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d0765-9956-4a95-bf33-4924a9ea2b31 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:16.991094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:16.991968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:16.992279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:16.992633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] PATH_INFO: `/v3/users/d01273c4526f41e6abb63cd4a4493d06` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:16.994930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01273c4526f41e6abb63cd4a4493d06)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:16.995930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.040129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01273c4526f41e6abb63cd4a4493d06'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.047146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01273c4526f41e6abb63cd4a4493d06'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.055697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01273c4526f41e6abb63cd4a4493d06'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.056472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01273c4526f41e6abb63cd4a4493d06'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.069237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01273c4526f41e6abb63cd4a4493d06'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.075266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1072/2174] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:16 2022] DELETE /identity/v3/users/d01273c4526f41e6abb63cd4a4493d06 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:17.079667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.080163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.080387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.098242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:17.099502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.156975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1103/2175] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:17.167241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.169279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.227941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54e632-83b7-4142-b4e5-26d8b4dfedc8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:17.231782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:17.232466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.232751 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.233025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.243740 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:17.245194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.255077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1073/2176] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:17.537940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.540927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.542481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.543821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.556737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadac5f-1e1b-4eaf-9467-edd597afb7a9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:17.562218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:17.563192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.563587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.564936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] PATH_INFO: `/v3/projects/f4b3a6d2500042178a16153b1ad589d3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.566336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b3a6d2500042178a16153b1ad589d3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:17.568357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.574103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645cf05-06be-41e9-bb74-7148049bdaec service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:17.583441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:17.584573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.585011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.585431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] PATH_INFO: `/v3/users/9d3fea140cc34e9bb3515876c9715d52` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.586875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3fea140cc34e9bb3515876c9715d52)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:17.589084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.652627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b3a6d2500042178a16153b1ad589d3', 'request_id': 'req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.668665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3fea140cc34e9bb3515876c9715d52'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.671901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b3a6d2500042178a16153b1ad589d3', 'request_id': 'req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.680386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3fea140cc34e9bb3515876c9715d52'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.687962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b3a6d2500042178a16153b1ad589d3', 'request_id': 'req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.691511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3fea140cc34e9bb3515876c9715d52'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.692800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3fea140cc34e9bb3515876c9715d52'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.708273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] The token cache is being invalidate because project f4b3a6d2500042178a16153b1ad589d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:17.708477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.709167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3ff20fa7-6fd3-4d28-a06f-1b305e8e9d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.715988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1104/2177] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:17 2022] DELETE /identity/v3/projects/f4b3a6d2500042178a16153b1ad589d3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:17.719304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cc66894c-cfc0-453f-bfd9-ddaf615cd2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3fea140cc34e9bb3515876c9715d52'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:17.726146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09550d-60ea-4800-b08f-e8aa4812a48b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.727120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09550d-60ea-4800-b08f-e8aa4812a48b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.727493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09550d-60ea-4800-b08f-e8aa4812a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.732824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1074/2178] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:17 2022] DELETE /identity/v3/users/9d3fea140cc34e9bb3515876c9715d52 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:17.734744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.735036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.735361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.752810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ba09550d-60ea-4800-b08f-e8aa4812a48b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:17.753457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:17.754211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ba09550d-60ea-4800-b08f-e8aa4812a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.754655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.828037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1105/2179] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:17.828875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1075/2180] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:58:17.841162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.842599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.843095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.848436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.850304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.866333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:17.867508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:17.875500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1106/2181] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:17.880390 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.890318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11c7e-a737-4ba6-b736-5fd34fe4ed3f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:17.896242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:17.896982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.897332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.897678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.898534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:58:17.898970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:17.900655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.906972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb99fa-d425-4d19-b09f-cb705d8487ba None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:17.911303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:17.911886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.912162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.912764 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.918166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1107/2182] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 16:58:17.919261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.922220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:17.923677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.929011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289ce45-0cd1-417c-a161-b84b52726db4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:17.933699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:17.933860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1076/2183] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:58:17.934547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:17.934892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:17.935258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:17.936006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:17.938035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:17.973224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1108/2184] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:58:17 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:17.974698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:17.984798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342015-4c9f-434c-b263-b36a60fa9b6d service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.041382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.042092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.042370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.042644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.043328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.045295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.064477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1077/2185] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:58:17 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:18.069116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.082837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8baced-d6b7-4507-8112-3e9fe7561e8e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.090181 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.090862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.091136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.091404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.092159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.094688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.106326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1109/2186] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:58:18.110261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.125674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689313b-fe3d-4e86-badc-d8429fcc29c3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.131820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ceafc-9e87-4531-9eaa-1461a0b94f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.132381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ceafc-9e87-4531-9eaa-1461a0b94f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.132699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ceafc-9e87-4531-9eaa-1461a0b94f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.133452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ceafc-9e87-4531-9eaa-1461a0b94f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.133713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ceafc-9e87-4531-9eaa-1461a0b94f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.135366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ceafc-9e87-4531-9eaa-1461a0b94f19 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.152463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1078/2187] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:58:18.153884 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.163519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17163a-7ef7-4246-976e-3da9fb9c959d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.167980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.168842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.169115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.169385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] PATH_INFO: `/v3/projects/4da590f0a8494d46a4fc4f426d25cefe/users/13320677155248f9864e11347a251788/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.189217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da590f0a8494d46a4fc4f426d25cefe, user_id=13320677155248f9864e11347a251788, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.192645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.205509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1110/2188] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:58:18 2022] PUT /identity/v3/projects/4da590f0a8494d46a4fc4f426d25cefe/users/13320677155248f9864e11347a251788/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:18.217750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.218033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.218306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.245633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.247343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:18.250662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] MFA Rules not processed for user `13320677155248f9864e11347a251788`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:18.254011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:18.321154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2769e9-da50-47b2-b843-fbba93f759d2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.325919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.326843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.327218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.327394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] PATH_INFO: `/v3/projects/f4e5995c47304182a7cb10c827e030b7` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.328595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1079/2189] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:18.328718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e5995c47304182a7cb10c827e030b7)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.330676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.345391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.346828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:18.386652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e5995c47304182a7cb10c827e030b7', 'request_id': 'req-9e395ff7-b9ce-46b1-8f35-04708b594c0c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:18.393870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e5995c47304182a7cb10c827e030b7', 'request_id': 'req-9e395ff7-b9ce-46b1-8f35-04708b594c0c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:18.399290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e5995c47304182a7cb10c827e030b7', 'request_id': 'req-9e395ff7-b9ce-46b1-8f35-04708b594c0c'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:18.401041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156cd24-23a0-447c-9e1d-7c6455f5150b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.419399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] The token cache is being invalidate because project f4e5995c47304182a7cb10c827e030b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:18.419870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:18.420545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9e395ff7-b9ce-46b1-8f35-04708b594c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:18.422922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1111/2190] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:18 2022] DELETE /identity/v3/projects/f4e5995c47304182a7cb10c827e030b7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:18.428177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daf625-a419-46d2-8e20-90da65ef49f3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.428459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daf625-a419-46d2-8e20-90da65ef49f3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.428732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daf625-a419-46d2-8e20-90da65ef49f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.446778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-29daf625-a419-46d2-8e20-90da65ef49f3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:18.447968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-29daf625-a419-46d2-8e20-90da65ef49f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:18.450426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.451066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.451456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.451729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.453567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:18.506458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1112/2191] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:18.508676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.510163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.513906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.514192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.514484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.519429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1080/2192] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:18.535451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:18.536634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:18.545251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1113/2193] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:58:18.548858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.568318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2a6f-c3b9-4ac4-a5e5-9156a256741e service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.573057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.573800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.574318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.574625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.575420 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:58:18.575729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.577357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.589770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1081/2194] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:58:18.593353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.602978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e79cf-62f9-4121-832e-97cd05d32537 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.607694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.608361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.608634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.608902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.609579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.611618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.638019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1114/2195] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:58:18 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:18.642396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.652980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f7278-8bca-44ac-871c-2491d031d5f7 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.713931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.714852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.715415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.715824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.716762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.719155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.745123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1082/2196] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:58:18 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:18.750131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.768678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9427ad-41c3-42b1-84f1-e4d865e24bbd admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.775175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.776270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.776893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.777614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.778873 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.781079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.796275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1115/2197] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:58:18.800707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.812590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5adc3-0d96-4130-8e59-23779e38bce5 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.819058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b85e88-1de5-43bb-bce2-b3c4685883d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.819857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b85e88-1de5-43bb-bce2-b3c4685883d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.820348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b85e88-1de5-43bb-bce2-b3c4685883d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.820754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b85e88-1de5-43bb-bce2-b3c4685883d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.821949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b85e88-1de5-43bb-bce2-b3c4685883d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.823886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b85e88-1de5-43bb-bce2-b3c4685883d8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.836799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1083/2198] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:58:18.840795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:18.852408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92a131-3ef1-46e4-a258-f8ae069299de admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:18.857475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:18.858394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.858664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.858927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] PATH_INFO: `/v3/projects/db3b04ecacc24f3faf5c0ccdbed9ea13/users/b34cde0e199c4f888d78e0a2010245a1/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.874816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3b04ecacc24f3faf5c0ccdbed9ea13, user_id=b34cde0e199c4f888d78e0a2010245a1, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:18.877663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:18.893267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1116/2199] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:58:18 2022] PUT /identity/v3/projects/db3b04ecacc24f3faf5c0ccdbed9ea13/users/b34cde0e199c4f888d78e0a2010245a1/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:18.903661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:18.903958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:18.904322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:18.937660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] MFA Rules not processed for user `b34cde0e199c4f888d78e0a2010245a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:18.938840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:19.000866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1084/2200] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:19.012322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:19.014071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:19.068505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc65c4-3889-4ce8-918a-95d68c488d32 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:19.072187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c081f2-6045-49c7-8168-a2768830c263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:19.072821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c081f2-6045-49c7-8168-a2768830c263 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:19.073099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c081f2-6045-49c7-8168-a2768830c263 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:19.073369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c081f2-6045-49c7-8168-a2768830c263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:19.081927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c081f2-6045-49c7-8168-a2768830c263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:19.083361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c081f2-6045-49c7-8168-a2768830c263 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:19.091958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1117/2201] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:19.117326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:19.182474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca3a2f-ab7b-40e9-af9f-2ad58d525b06 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:19.187124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:19.188034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:19.188263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:19.188536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] PATH_INFO: `/v3/users/b34cde0e199c4f888d78e0a2010245a1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:19.189756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34cde0e199c4f888d78e0a2010245a1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:19.191714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:19.240272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34cde0e199c4f888d78e0a2010245a1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.247389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34cde0e199c4f888d78e0a2010245a1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.254499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34cde0e199c4f888d78e0a2010245a1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.255121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34cde0e199c4f888d78e0a2010245a1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.266235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34cde0e199c4f888d78e0a2010245a1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.272487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1085/2202] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:19 2022] DELETE /identity/v3/users/b34cde0e199c4f888d78e0a2010245a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:19.276982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:19.277289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:19.277588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:19.295426 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:19.296648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:19.369483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1118/2203] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:19.379991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:19.381496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:19.439539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8214b-7414-4a59-9ea5-7293637aae57 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:19.443214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a60f0-f701-4138-9bc7-9a796c122e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:19.443855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a60f0-f701-4138-9bc7-9a796c122e4d service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:19.444134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a60f0-f701-4138-9bc7-9a796c122e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:19.444407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a60f0-f701-4138-9bc7-9a796c122e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:19.453293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a60f0-f701-4138-9bc7-9a796c122e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:19.454709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a60f0-f701-4138-9bc7-9a796c122e4d service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:19.463847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1086/2204] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:58:19.728790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:19.730239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:19.742868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e4938-b883-49fb-8a6f-d228061ce4de None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:19.749075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:19.750055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:19.750329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:19.750595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] PATH_INFO: `/v3/projects/db3b04ecacc24f3faf5c0ccdbed9ea13` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:19.751768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3b04ecacc24f3faf5c0ccdbed9ea13)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:19.753713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:19.804230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3b04ecacc24f3faf5c0ccdbed9ea13', 'request_id': 'req-39208b2a-3000-4908-aeb8-496c7055797a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.811902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3b04ecacc24f3faf5c0ccdbed9ea13', 'request_id': 'req-39208b2a-3000-4908-aeb8-496c7055797a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.818959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3b04ecacc24f3faf5c0ccdbed9ea13', 'request_id': 'req-39208b2a-3000-4908-aeb8-496c7055797a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.831745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] The token cache is being invalidate because project db3b04ecacc24f3faf5c0ccdbed9ea13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:19.832023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.832676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:19.834393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1119/2205] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:19 2022] DELETE /identity/v3/projects/db3b04ecacc24f3faf5c0ccdbed9ea13 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:25.999675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112531a-8f26-4503-88dd-61d742466a64 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:26.000155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112531a-8f26-4503-88dd-61d742466a64 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:26.000243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112531a-8f26-4503-88dd-61d742466a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:26.017522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6112531a-8f26-4503-88dd-61d742466a64 None None] MFA Rules not processed for user `13a6ce9b67564caab0892fc443073202`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:26.018734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6112531a-8f26-4503-88dd-61d742466a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:26.075984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1087/2206] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:40.144195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:40.145948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:40.268876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39208b2a-3000-4908-aeb8-496c7055797a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:40.274262 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:40.275116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:40.275393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:40.275663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] PATH_INFO: `/v3/users/13320677155248f9864e11347a251788` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:40.276857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13320677155248f9864e11347a251788)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:40.279207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:40.324798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13320677155248f9864e11347a251788'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:40.331229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13320677155248f9864e11347a251788'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:40.338515 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13320677155248f9864e11347a251788'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:40.350299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13320677155248f9864e11347a251788'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:40.350869 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13320677155248f9864e11347a251788'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:40.356624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1120/2207] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:40 2022] DELETE /identity/v3/users/13320677155248f9864e11347a251788 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:40.360998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:40.361506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:40.361589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:40.387739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:40.388950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:40.461007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1088/2208] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:40.474644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:40.476264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:40.594080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd04b-22db-484e-af58-211fbd4c2bf7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:40.599330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255ea43-8b56-4629-a922-cf6bd95e9af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:40.599992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ea43-8b56-4629-a922-cf6bd95e9af9 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:40.600535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ea43-8b56-4629-a922-cf6bd95e9af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:40.601121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ea43-8b56-4629-a922-cf6bd95e9af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:40.610905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255ea43-8b56-4629-a922-cf6bd95e9af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:40.612352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255ea43-8b56-4629-a922-cf6bd95e9af9 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:40.622141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1121/2209] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:58:41.023604 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.027141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.040992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96afb-0f3d-4b4b-a0ab-2e80f9ad5269 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.059372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.060397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.060838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.061177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] PATH_INFO: `/v3/projects/4da590f0a8494d46a4fc4f426d25cefe` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.062767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da590f0a8494d46a4fc4f426d25cefe)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.065600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.118335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da590f0a8494d46a4fc4f426d25cefe', 'request_id': 'req-33a0f700-61a9-450f-afbd-ee297346950d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.125850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da590f0a8494d46a4fc4f426d25cefe', 'request_id': 'req-33a0f700-61a9-450f-afbd-ee297346950d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.131592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da590f0a8494d46a4fc4f426d25cefe', 'request_id': 'req-33a0f700-61a9-450f-afbd-ee297346950d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.142402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] The token cache is being invalidate because project 4da590f0a8494d46a4fc4f426d25cefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:41.142686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.143329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-33a0f700-61a9-450f-afbd-ee297346950d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.144874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1089/2210] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:41 2022] DELETE /identity/v3/projects/4da590f0a8494d46a4fc4f426d25cefe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:41.149828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.150300 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.150520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.188224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:41.189505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.252128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1122/2211] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:41.259857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09894553-3506-4913-8cec-b69db67a856c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.260144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09894553-3506-4913-8cec-b69db67a856c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.260428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09894553-3506-4913-8cec-b69db67a856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.278901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-09894553-3506-4913-8cec-b69db67a856c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:41.280093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-09894553-3506-4913-8cec-b69db67a856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.293891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1090/2212] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:41.296406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.310567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab829a6d-fe1e-48e3-a74e-e19082fca32b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.315273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.315932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.316214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.316483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.317209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:58:41.317510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.319204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.331964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1123/2213] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:58:41.336185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09894553-3506-4913-8cec-b69db67a856c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.345225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09894553-3506-4913-8cec-b69db67a856c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.350575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.351228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.351499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.351758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.352468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.354434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.383909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1091/2214] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:58:41 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:41.385759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.396200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb40dc9-7632-42d9-ab44-25e47a412e54 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.466039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.466826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.467107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.467427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.468134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.470296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.490441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1124/2215] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:58:41 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:58:41.494640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.505401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f404-bd6e-4f37-99e7-8e239c3084c6 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.510973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.511701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.512092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.512422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.513278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.515006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.526100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1092/2216] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:58:41.530065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.540446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2428ccc-5796-4634-84c3-abd300947f00 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.545203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.545795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.546076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.546402 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.547131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.549485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.563521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1125/2217] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:58:41.565197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.575760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ef872-f710-4a57-be15-a4ca432f29ca admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.583551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.585849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.594499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0c49-19e3-4343-938c-76461c3993ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.600315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec58b5-b4cc-4081-a7d6-cda633b57524 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.601980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0c49-19e3-4343-938c-76461c3993ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.602620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0c49-19e3-4343-938c-76461c3993ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.603969 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0c49-19e3-4343-938c-76461c3993ce admin admin] PATH_INFO: `/v3/projects/860206f7b662414ca56ef58314ad4a5a/users/6866ee078cd54f469aa188209fac9b95/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.606921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.607908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.608271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.608555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] PATH_INFO: `/v3/users/6febf66814d844e48db20e9f46567b05` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.609991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6febf66814d844e48db20e9f46567b05)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.612200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.626370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0c49-19e3-4343-938c-76461c3993ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=860206f7b662414ca56ef58314ad4a5a, user_id=6866ee078cd54f469aa188209fac9b95, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.630309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0c49-19e3-4343-938c-76461c3993ce admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.657582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1093/2218] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:58:41 2022] PUT /identity/v3/projects/860206f7b662414ca56ef58314ad4a5a/users/6866ee078cd54f469aa188209fac9b95/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:58:41.661084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.661705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.663661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.670517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6febf66814d844e48db20e9f46567b05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.678804 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6febf66814d844e48db20e9f46567b05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.687994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6febf66814d844e48db20e9f46567b05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.691629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:41.693201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.703134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6febf66814d844e48db20e9f46567b05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.703888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-04a66540-e454-4e2b-a791-e8f48eb7ace8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6febf66814d844e48db20e9f46567b05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:41.712782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1126/2219] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 16:58:41 2022] DELETE /identity/v3/users/6febf66814d844e48db20e9f46567b05 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:41.719862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.720403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.720898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.741996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:41.743977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.771744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1094/2220] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:41.782847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.784249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.812380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1127/2221] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:41.822622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:41.824024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:41.850239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10be00-ebb3-4231-a687-7f6e6ffb5479 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.884273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ba78-923f-460f-b412-05c54aefa61c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:41.888720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.889475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.889885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.890159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.903768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.905441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.906045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1e3cc-34b9-4c5f-9aeb-8fcd59fc64f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:41.906901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e3cc-34b9-4c5f-9aeb-8fcd59fc64f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:41.907544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e3cc-34b9-4c5f-9aeb-8fcd59fc64f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:41.908097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e3cc-34b9-4c5f-9aeb-8fcd59fc64f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:41.915472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1128/2222] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:58:41.919011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1e3cc-34b9-4c5f-9aeb-8fcd59fc64f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:41.920444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1e3cc-34b9-4c5f-9aeb-8fcd59fc64f1 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:41.930287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1095/2223] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 16:58:42.471328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:42.472751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:42.512818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2d781-db90-4528-ad39-f60fbd8c9ca6 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:42.540307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:42.541924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:42.542207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:42.542604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] PATH_INFO: `/v3/projects/3b507c2836cd48e69837d0408f1af826` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:42.543983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b507c2836cd48e69837d0408f1af826)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:42.546850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:42.632442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b507c2836cd48e69837d0408f1af826', 'request_id': 'req-e06fb8c0-d6c0-4395-8539-da06dab925c2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:42.642862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b507c2836cd48e69837d0408f1af826', 'request_id': 'req-e06fb8c0-d6c0-4395-8539-da06dab925c2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:42.649389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b507c2836cd48e69837d0408f1af826', 'request_id': 'req-e06fb8c0-d6c0-4395-8539-da06dab925c2'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:42.660531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] The token cache is being invalidate because project 3b507c2836cd48e69837d0408f1af826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 16:58:42.661033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:42.662379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e06fb8c0-d6c0-4395-8539-da06dab925c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 16:58:42.663787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1129/2224] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 16:58:42 2022] DELETE /identity/v3/projects/3b507c2836cd48e69837d0408f1af826 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 16:58:42.670072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:42.670554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:42.670688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:42.697761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:42.699246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:42.806614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1096/2225] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:42.814694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:42.815435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:42.815922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:42.838739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:42.840171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:42.857600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1130/2226] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:42.863755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:42.890486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7feeb-7c92-467a-857b-05430dd4ad54 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:42.900324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:42.901359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:42.901833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:42.902392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:42.903427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 16:58:42.903893 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:42.906573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:42.921858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1097/2227] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 16:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 16:58:42.925639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:42.937691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7742c-0019-4bd1-a27b-dd85fc472542 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:42.943185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:42.944024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:42.944587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:42.944870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:42.945673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:42.948043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:42.988349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1131/2228] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 16:58:42 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 16:58:42.992112 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:43.004743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b9a7-b728-4f75-93ec-2447e00b214d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:43.118710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f361e6-c32e-47c9-9944-56ab504771ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:43.120343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f361e6-c32e-47c9-9944-56ab504771ff admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.120695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f361e6-c32e-47c9-9944-56ab504771ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.120988 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f361e6-c32e-47c9-9944-56ab504771ff admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.121880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f361e6-c32e-47c9-9944-56ab504771ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:43.125640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f361e6-c32e-47c9-9944-56ab504771ff admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:43.171800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1098/2229] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 16:58:42 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 16:58:43.175661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:43.191135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ef95-f7c6-49c1-a05e-772c1a1dda6b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:43.206006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:43.206703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.207120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.208003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.209295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:43.211113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:43.219855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.220148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.220430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.237292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1132/2230] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 16:58:43.241095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:43.262966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee240d3-3fa3-4569-8d26-16fb4fca40d7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:43.266874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] MFA Rules not processed for user `6866ee078cd54f469aa188209fac9b95`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:43.269304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:43.273832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:43.275233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.275587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.275867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.277084 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:43.283217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:43.305042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1133/2231] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 16:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 16:58:43.310427 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:43.328623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a1995-85ca-4bac-9156-6f25b257b9e9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:43.340826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9ae25-b172-4e20-bbf9-c4b7787e4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:43.341729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ae25-b172-4e20-bbf9-c4b7787e4227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.342033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ae25-b172-4e20-bbf9-c4b7787e4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.342307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9ae25-b172-4e20-bbf9-c4b7787e4227 admin admin] PATH_INFO: `/v3/projects/e07bcaeeb617491689c13594914b370e/users/3ab541e9017c4ece9432f1fedde0f64e/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.371463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9ae25-b172-4e20-bbf9-c4b7787e4227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07bcaeeb617491689c13594914b370e, user_id=3ab541e9017c4ece9432f1fedde0f64e, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:43.375740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9ae25-b172-4e20-bbf9-c4b7787e4227 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:43.406157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1134/2232] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 16:58:43 2022] PUT /identity/v3/projects/e07bcaeeb617491689c13594914b370e/users/3ab541e9017c4ece9432f1fedde0f64e/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 16:58:43.406565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1099/2233] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:58:43.413114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.413114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.413114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.423771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:43.425349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:43.457466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:43.459992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:43.522819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48faf5f-164a-4e91-9222-0fb05bb6fb7d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:43.539211 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1135/2234] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:43.564343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:43.576140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:43.607583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efeb86-b85a-4c23-88a4-b11b6c4269af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:43.608429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efeb86-b85a-4c23-88a4-b11b6c4269af service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.608700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efeb86-b85a-4c23-88a4-b11b6c4269af service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.609058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efeb86-b85a-4c23-88a4-b11b6c4269af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.686345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da80634-39ee-4586-8bb0-df110c57c835 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:43.690288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:43.694202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:43.694593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:43.694959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:43.701471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efeb86-b85a-4c23-88a4-b11b6c4269af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:43.703543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efeb86-b85a-4c23-88a4-b11b6c4269af service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:43.711699 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:43.713631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:43.718183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1100/2235] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:43.724571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1136/2236] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:44.599951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc56f-8576-422b-b95b-0aa905ebd024 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:44.600288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc56f-8576-422b-b95b-0aa905ebd024 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:44.600572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc56f-8576-422b-b95b-0aa905ebd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:44.658970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1c1dc56f-8576-422b-b95b-0aa905ebd024 None None] MFA Rules not processed for user `3ab541e9017c4ece9432f1fedde0f64e`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:44.661230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1c1dc56f-8576-422b-b95b-0aa905ebd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:44.758228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1101/2237] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:44.769106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:58:44.770637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:44.783935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd847-d68a-40f0-a48e-8a2bce3f8f70 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:58:44.789365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bfe4f-54ac-4f09-aa62-db54d656b9bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:58:44.790130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bfe4f-54ac-4f09-aa62-db54d656b9bb service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:44.790478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bfe4f-54ac-4f09-aa62-db54d656b9bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:44.792189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bfe4f-54ac-4f09-aa62-db54d656b9bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:44.801564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bfe4f-54ac-4f09-aa62-db54d656b9bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:58:44.803212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bfe4f-54ac-4f09-aa62-db54d656b9bb service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:58:44.813001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1137/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:58:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:58:45.174975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d15e1-caa5-4c4c-92f2-093cf20a7015 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:45.175300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d15e1-caa5-4c4c-92f2-093cf20a7015 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:45.175526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d15e1-caa5-4c4c-92f2-093cf20a7015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:45.196192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f09d15e1-caa5-4c4c-92f2-093cf20a7015 None None] MFA Rules not processed for user `6866ee078cd54f469aa188209fac9b95`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:45.197460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f09d15e1-caa5-4c4c-92f2-093cf20a7015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:45.205687 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1102/2239] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:58:46.233355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:58:46.233840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:58:46.234005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:58:46.296228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] MFA Rules not processed for user `3ab541e9017c4ece9432f1fedde0f64e`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:58:46.297436 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:58:46.307260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1138/2240] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:05.887915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb37c7-0d3a-42bc-ba10-e1e23d9734b2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:05.888434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb37c7-0d3a-42bc-ba10-e1e23d9734b2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:05.888535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb37c7-0d3a-42bc-ba10-e1e23d9734b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:05.905967 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-44bb37c7-0d3a-42bc-ba10-e1e23d9734b2 None None] MFA Rules not processed for user `6866ee078cd54f469aa188209fac9b95`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:05.907190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-44bb37c7-0d3a-42bc-ba10-e1e23d9734b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:05.915889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1103/2241] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:08.366674 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:08.376056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69711ca3-d1f6-445c-8d62-5b956751b0c0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:08.379645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:08.380281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:08.380555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:08.380856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:08.382676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:08.474733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:08.476177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:08.485969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1139/2242] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:59:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:59:16.007392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab978-8f7f-40d1-8da0-d94c86953646 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:16.007848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab978-8f7f-40d1-8da0-d94c86953646 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:16.007848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab978-8f7f-40d1-8da0-d94c86953646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:16.035368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d11ab978-8f7f-40d1-8da0-d94c86953646 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:16.036555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d11ab978-8f7f-40d1-8da0-d94c86953646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:16.096884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1104/2243] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:16.138877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:16.140322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:16.205539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a1a37-63df-41ee-93c1-e16339a4958a service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:16.210640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30946bb-9a12-408f-b2ca-d9555e2f2e91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:16.211277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30946bb-9a12-408f-b2ca-d9555e2f2e91 service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:16.211549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30946bb-9a12-408f-b2ca-d9555e2f2e91 service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:16.211815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30946bb-9a12-408f-b2ca-d9555e2f2e91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:16.219986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30946bb-9a12-408f-b2ca-d9555e2f2e91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:16.221606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30946bb-9a12-408f-b2ca-d9555e2f2e91 service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:16.230265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1140/2244] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 16:59:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 16:59:41.660376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6447-963b-41b1-8a91-33a4c039fadc None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:41.661055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6447-963b-41b1-8a91-33a4c039fadc None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:41.661055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe6447-963b-41b1-8a91-33a4c039fadc None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:41.662957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1105/2245] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:59:41.669281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcc750-57dc-4a93-8b1c-c600acfaf392 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:41.669824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcc750-57dc-4a93-8b1c-c600acfaf392 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:41.669969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcc750-57dc-4a93-8b1c-c600acfaf392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:41.732906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-1edcc750-57dc-4a93-8b1c-c600acfaf392 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:41.734669 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1edcc750-57dc-4a93-8b1c-c600acfaf392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:41.822970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1141/2246] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:41.834771 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe6447-963b-41b1-8a91-33a4c039fadc None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:41.836433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-debe6447-963b-41b1-8a91-33a4c039fadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:41.911208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe6447-963b-41b1-8a91-33a4c039fadc None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:41.914699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0433f-fcf3-4d55-8304-ab2d361bba94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:41.915326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0433f-fcf3-4d55-8304-ab2d361bba94 service glance] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:41.915702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0433f-fcf3-4d55-8304-ab2d361bba94 service glance] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:41.915971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0433f-fcf3-4d55-8304-ab2d361bba94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:41.925646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0433f-fcf3-4d55-8304-ab2d361bba94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:41.927090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0433f-fcf3-4d55-8304-ab2d361bba94 service glance] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:41.937278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1106/2247] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:59:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:59:42.001587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c072b5-96ee-411e-89ed-c68e8769745f None None] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:42.001984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c072b5-96ee-411e-89ed-c68e8769745f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:42.002330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c072b5-96ee-411e-89ed-c68e8769745f None None] PATH_INFO: `/` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:42.003770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1142/2248] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:59:42.009443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d8fbb-ecb4-43d3-b6ca-a2acc7dfe9b5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:42.009733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d8fbb-ecb4-43d3-b6ca-a2acc7dfe9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:42.010065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d8fbb-ecb4-43d3-b6ca-a2acc7dfe9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:42.028477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-181d8fbb-ecb4-43d3-b6ca-a2acc7dfe9b5 None None] MFA Rules not processed for user `4920e5f3dcdc4b068f4a0b3a1f9bc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:42.029662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-181d8fbb-ecb4-43d3-b6ca-a2acc7dfe9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:42.036226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1107/2249] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:42.047854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c072b5-96ee-411e-89ed-c68e8769745f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:42.049572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-83c072b5-96ee-411e-89ed-c68e8769745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:42.064785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c072b5-96ee-411e-89ed-c68e8769745f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:42.068878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f81b9-e540-44e9-8a8f-1ad699706e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:42.069514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f81b9-e540-44e9-8a8f-1ad699706e51 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:42.069828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f81b9-e540-44e9-8a8f-1ad699706e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:42.070102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f81b9-e540-44e9-8a8f-1ad699706e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:42.077421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f81b9-e540-44e9-8a8f-1ad699706e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:42.078902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f81b9-e540-44e9-8a8f-1ad699706e51 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:42.087261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1143/2250] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:59:42.166477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504c95-d4a9-49a0-8ec0-cbfc4a19e5bd None None] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:42.166757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504c95-d4a9-49a0-8ec0-cbfc4a19e5bd None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:42.167032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c504c95-d4a9-49a0-8ec0-cbfc4a19e5bd None None] PATH_INFO: `/` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:42.168430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1108/2251] 10.222.0.70 () {54 vars in 921 bytes} [Mon May 16 16:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 16 16:59:42.174122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb67471-6d27-4bfe-abbf-0658da685cb5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:42.174509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb67471-6d27-4bfe-abbf-0658da685cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:42.174789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb67471-6d27-4bfe-abbf-0658da685cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:42.193792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5fb67471-6d27-4bfe-abbf-0658da685cb5 None None] MFA Rules not processed for user `fc0134f8e7c1401eb79c443f67174a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:42.194908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5fb67471-6d27-4bfe-abbf-0658da685cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:42.203957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1144/2252] 10.222.0.70 () {58 vars in 1018 bytes} [Mon May 16 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:42.214000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c504c95-d4a9-49a0-8ec0-cbfc4a19e5bd None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:42.225049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c504c95-d4a9-49a0-8ec0-cbfc4a19e5bd None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:42.228532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:42.229145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:42.229417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:42.229685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:42.240015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:42.241429 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:42.251678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1109/2253] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:59:44.656859 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:44.657349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:44.657536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:44.707753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:44.708898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:44.726059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1145/2254] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:59:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 16:59:44.738134 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:44.763326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7827b0f-b01b-4077-b40c-2400e5e61852 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:44.770760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60980612-356f-46ac-9576-606bba637d2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:44.771717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60980612-356f-46ac-9576-606bba637d2b service swift] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:44.772157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60980612-356f-46ac-9576-606bba637d2b service swift] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:44.772515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60980612-356f-46ac-9576-606bba637d2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:44.782127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60980612-356f-46ac-9576-606bba637d2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:44.783838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60980612-356f-46ac-9576-606bba637d2b service swift] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:44.792069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1110/2255] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 16:59:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 16:59:47.774435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:47.775980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:47.938093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85df06-3760-41da-8325-a7bcb2719e22 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:47.949952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:47.951108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:47.952512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:47.953509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:47.958941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:47.990204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:47.991974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:48.015978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1146/2256] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 16:59:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 16:59:58.398142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf716-fa87-497f-98ef-6340eba44d64 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:58.398714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf716-fa87-497f-98ef-6340eba44d64 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:58.398714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf716-fa87-497f-98ef-6340eba44d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:58.427293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b2dcf716-fa87-497f-98ef-6340eba44d64 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 16:59:58.428514 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b2dcf716-fa87-497f-98ef-6340eba44d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 16:59:58.440975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1111/2257] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 16:59:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 16:59:58.453281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 16:59:58.467385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cef9a-d32d-45ee-b0fc-12d2b5c6a0b2 service placement] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 16:59:58.473349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd9032-ec6f-44b4-bfee-4411c6c16c9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 16:59:58.474261 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd9032-ec6f-44b4-bfee-4411c6c16c9d service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 16:59:58.474723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd9032-ec6f-44b4-bfee-4411c6c16c9d service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 16:59:58.475059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd9032-ec6f-44b4-bfee-4411c6c16c9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 16:59:58.488236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd9032-ec6f-44b4-bfee-4411c6c16c9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 16:59:58.490525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd9032-ec6f-44b4-bfee-4411c6c16c9d service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 16:59:58.510312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1147/2258] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 16:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:00:01.686704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:01.688249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:01.688555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:01.712918 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] MFA Rules not processed for user `673ff42fb9454adf93be94f46e60755a`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:01.714896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:01.861237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1112/2259] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:06.128085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078a74-1ca4-4903-8a3f-f20eab9e0256 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:06.128693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078a74-1ca4-4903-8a3f-f20eab9e0256 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:06.128693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a078a74-1ca4-4903-8a3f-f20eab9e0256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:06.148352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0a078a74-1ca4-4903-8a3f-f20eab9e0256 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:06.149698 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0a078a74-1ca4-4903-8a3f-f20eab9e0256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:06.157068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1148/2260] 10.222.0.70 () {58 vars in 967 bytes} [Mon May 16 17:00:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:06.171609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:06.183736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2e049-a3e9-4ffb-a13b-599ddfa80c91 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:06.188676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:06.189318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:06.189594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:06.189892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:06.198597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:06.200194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:06.211591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1113/2261] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:00:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:00:10.863976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:10.864534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:10.864534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:10.881123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] MFA Rules not processed for user `3ab541e9017c4ece9432f1fedde0f64e`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:10.882329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:10.889153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1149/2262] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:11.596508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:11.596508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:11.605858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8123e3-dd79-462e-a545-9390b906efdf service swift] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:11.615520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:11.616349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:11.616631 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:11.616904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] PATH_INFO: `/v3/users/6866ee078cd54f469aa188209fac9b95` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:11.618293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6866ee078cd54f469aa188209fac9b95)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:11.620688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:11.677192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6866ee078cd54f469aa188209fac9b95'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:11.687494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6866ee078cd54f469aa188209fac9b95'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:11.703274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6866ee078cd54f469aa188209fac9b95'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:11.703968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6866ee078cd54f469aa188209fac9b95'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:11.715896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-61cf57b9-7b02-48b4-8fe5-268d32ab272b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6866ee078cd54f469aa188209fac9b95'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:11.721984 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1114/2263] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:00:11 2022] DELETE /identity/v3/users/6866ee078cd54f469aa188209fac9b95 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:00:11.903446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:11.915048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73b38-6cde-45d8-ad31-bf1c8f27f13f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:11.979885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:11.980737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:11.981015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:11.981287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] PATH_INFO: `/v3/projects/860206f7b662414ca56ef58314ad4a5a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:11.982620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] RBAC: Authorizing `identity:delete_project(project_id=860206f7b662414ca56ef58314ad4a5a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:11.984614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.027583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860206f7b662414ca56ef58314ad4a5a', 'request_id': 'req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:12.034032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860206f7b662414ca56ef58314ad4a5a', 'request_id': 'req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:12.040052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860206f7b662414ca56ef58314ad4a5a', 'request_id': 'req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:12.051457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] The token cache is being invalidate because project 860206f7b662414ca56ef58314ad4a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:00:12.051866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:12.056025 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-737f0e1b-4b9b-4458-86d3-7dbc09eb633a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:00:12.058408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1150/2264] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:00:11 2022] DELETE /identity/v3/projects/860206f7b662414ca56ef58314ad4a5a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:00:12.064692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.064982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.065261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.084149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:12.085327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:12.149468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1115/2265] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:12.156908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.157195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.157501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.180826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:12.182411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:12.190677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1151/2266] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:12.195547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.205782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e273c-12ab-4e56-9b75-48bbd8b5c97a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.210551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.211396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.211646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.211929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.212784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:00:12.213094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.214810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.228327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1116/2267] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:00:12.232597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.251077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f7b45-eca5-4f92-a9ac-eb757727da9b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.257697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.258794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.259156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.259490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.260183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.262188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.297715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1152/2268] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:00:12 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:00:12.298835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.309570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11d7da-1260-4f76-8281-bad77ae48956 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.372289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.372880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.373157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.373426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.374155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.376087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.399303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1117/2269] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:00:12 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:00:12.403242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.420375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f501720-6a0d-463c-9702-2f3fb9e5dbbc admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.425182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.426548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.426824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.427088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.427985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.429763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.442290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1153/2270] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:00:12.446176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.456145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773984e-3767-4991-a13b-c44f8c390a32 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.460866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0d094-890a-49e3-9df1-4e65040a5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.461510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0d094-890a-49e3-9df1-4e65040a5ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.461817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0d094-890a-49e3-9df1-4e65040a5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.462093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0d094-890a-49e3-9df1-4e65040a5ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.462808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0d094-890a-49e3-9df1-4e65040a5ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.464460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0d094-890a-49e3-9df1-4e65040a5ed8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.474425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1118/2271] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:00:12.478518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.488764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6a5f-8022-43d3-a870-f982e25400dc admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.493414 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.494291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.494576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.494846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] PATH_INFO: `/v3/projects/513196f833e447a989898b7daee36ba3/users/39b7ce7aa84c42c0a14351feb37b4d9d/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.509243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] RBAC: Authorizing `identity:create_grant(project_id=513196f833e447a989898b7daee36ba3, user_id=39b7ce7aa84c42c0a14351feb37b4d9d, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.512085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.524546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1154/2272] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:00:12 2022] PUT /identity/v3/projects/513196f833e447a989898b7daee36ba3/users/39b7ce7aa84c42c0a14351feb37b4d9d/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:00:12.534363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbffc4f-5fba-40e6-8dac-09eaa71431bf None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.534645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbffc4f-5fba-40e6-8dac-09eaa71431bf None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.535465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbffc4f-5fba-40e6-8dac-09eaa71431bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.561122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5cbffc4f-5fba-40e6-8dac-09eaa71431bf None None] MFA Rules not processed for user `39b7ce7aa84c42c0a14351feb37b4d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:12.562343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5cbffc4f-5fba-40e6-8dac-09eaa71431bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:12.623717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1119/2273] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:00:12.634746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:12.636657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:12.716527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b8be-9a51-4080-aef9-de97f1aa587a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:12.721518 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29937c1d-5a2d-4488-b6df-e470021a52ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:12.722980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937c1d-5a2d-4488-b6df-e470021a52ea service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:12.723284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937c1d-5a2d-4488-b6df-e470021a52ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:12.723559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29937c1d-5a2d-4488-b6df-e470021a52ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:12.734448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29937c1d-5a2d-4488-b6df-e470021a52ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:12.736757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29937c1d-5a2d-4488-b6df-e470021a52ea service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:12.753866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1155/2274] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:00:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:00:14.126941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:14.127520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:14.127911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:14.152040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] MFA Rules not processed for user `39b7ce7aa84c42c0a14351feb37b4d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:14.153707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:14.182525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1120/2275] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:25.245940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987e446-cc46-4c98-bccf-897c71bb28dd None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:25.246500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987e446-cc46-4c98-bccf-897c71bb28dd None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:25.246500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987e446-cc46-4c98-bccf-897c71bb28dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:25.264521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7987e446-cc46-4c98-bccf-897c71bb28dd None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:25.265720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7987e446-cc46-4c98-bccf-897c71bb28dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:25.320900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1156/2276] 10.222.0.70 () {58 vars in 967 bytes} [Mon May 16 17:00:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:25.342450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:25.343849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:25.429847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efadcd0-5ba4-4af0-ad06-b3eb31bc417a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:25.434993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfd8f0-62c7-462b-b3c2-317048c618f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:25.435669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfd8f0-62c7-462b-b3c2-317048c618f2 service swift] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:25.435972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfd8f0-62c7-462b-b3c2-317048c618f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:25.436248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfd8f0-62c7-462b-b3c2-317048c618f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:25.445493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfd8f0-62c7-462b-b3c2-317048c618f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:25.447129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfd8f0-62c7-462b-b3c2-317048c618f2 service swift] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:25.456294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1121/2277] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:00:34.464616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:34.465122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:34.465231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:34.482754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] MFA Rules not processed for user `13a6ce9b67564caab0892fc443073202`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:34.483976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:34.536534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1157/2278] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:00:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:42.013923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a279ba4-2628-4cb4-ab4b-3961448e5e84 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:42.014435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a279ba4-2628-4cb4-ab4b-3961448e5e84 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:42.014518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a279ba4-2628-4cb4-ab4b-3961448e5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:42.032331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5a279ba4-2628-4cb4-ab4b-3961448e5e84 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:42.033655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5a279ba4-2628-4cb4-ab4b-3961448e5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:42.040968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1122/2279] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:42.053053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:42.064610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7db23-8a5d-4d11-8bf1-07d4b36ca65a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:42.070088 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:42.070733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:42.071011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:42.071285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:42.079584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:42.081240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:42.090345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1158/2280] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:00:42.589180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa455ad-f51b-4bc7-85df-d164fbae2c71 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:42.589466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa455ad-f51b-4bc7-85df-d164fbae2c71 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:42.589758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa455ad-f51b-4bc7-85df-d164fbae2c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:42.607528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2fa455ad-f51b-4bc7-85df-d164fbae2c71 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:42.608706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2fa455ad-f51b-4bc7-85df-d164fbae2c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:42.617242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1123/2281] 10.222.0.70 () {58 vars in 967 bytes} [Mon May 16 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:42.630105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:42.640621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c279bb9-f9d8-4a12-a759-8b2c39dac6e0 service swift] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:42.645626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:42.646403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:42.646745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:42.647394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:42.655525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:42.657091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:42.665828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1159/2282] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:00:42.860121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56bb2-5a06-4547-b447-8c418a1382b0 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:42.860407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56bb2-5a06-4547-b447-8c418a1382b0 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:42.860678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56bb2-5a06-4547-b447-8c418a1382b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:42.879597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-91f56bb2-5a06-4547-b447-8c418a1382b0 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:42.880792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-91f56bb2-5a06-4547-b447-8c418a1382b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:42.887950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1124/2283] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:00:42.900353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:42.911153 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e900dc-d74e-4534-ada8-848f64d5a341 service swift] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:42.916216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:42.916846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:42.917124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:42.917397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:42.925206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:42.926909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:42.934874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1160/2284] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:00:43.251530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:43.252014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:43.252128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:43.272513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:00:43.273704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:00:43.280858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1125/2285] 10.222.0.70 () {58 vars in 967 bytes} [Mon May 16 17:00:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:00:43.296204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:00:43.306796 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a15eb9-f3b1-4590-b1be-14bc456e711f service swift] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:00:43.311753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:00:43.312375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:00:43.312653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:00:43.312923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:00:43.321250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:00:43.322856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:00:43.330657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1161/2286] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:00:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:01:44.154993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:01:44.156474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:44.210323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2518d6b-af5d-4770-b478-4182cb3d57f4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:01:44.213908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:01:44.214545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:01:44.214822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:01:44.215092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:01:44.217008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:44.290289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:01:44.291746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:01:44.308025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1126/2287] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:01:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:01:45.325730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:01:45.327114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:45.339053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b892c-910f-439a-9046-6c8c8f00a9db service swift] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:01:45.342555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:01:45.343173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:01:45.343453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:01:45.343717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:01:45.345369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:45.356398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:01:45.357828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:01:45.366453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1162/2288] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:01:46.578053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:01:46.579449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:46.593319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c6aa7-1128-4bf1-9e35-44df05505199 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:01:46.605026 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:01:46.605707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:01:46.606016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:01:46.606289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:01:46.608128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:46.665256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:01:46.666813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:01:46.676229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1127/2289] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:01:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:01:51.059855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:01:51.068841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad11d6e-ac9c-4643-8cd7-83dfbaf26724 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:01:51.072467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:01:51.073091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:01:51.073366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:01:51.073635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:01:51.075454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:51.131059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:01:51.132497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:01:51.141489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1163/2290] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:01:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:01:54.414570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:01:54.424257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3073eea-e976-4607-b0fb-4943ca2149e8 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:01:54.428409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:01:54.429034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:01:54.429307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:01:54.429573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:01:54.431374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:01:54.440520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:01:54.442008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:01:54.449577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1128/2291] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:01:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:02:00.696600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:02:00.698157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:02:00.709506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6900a0-8c98-43c0-8dea-93c60a4e8a9e service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:02:00.713221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:02:00.713894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:02:00.714175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:02:00.714449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:02:00.716162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:02:00.729935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:02:00.731407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:02:00.742636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1164/2292] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:03:00.200377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:03:00.214575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaf650-5019-4714-b4be-456eb90c96d0 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:03:00.220281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:03:00.220923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:03:00.221200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:03:00.221473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:03:00.223909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:03:00.278017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:03:00.279586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:03:00.288761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1129/2293] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:03:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:03:36.456502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:03:36.466272 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28bca2-6a41-40f2-812f-412ade10de09 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:03:36.470224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:03:36.470860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:03:36.471137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:03:36.471410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:03:36.473171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:03:36.530348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:03:36.531807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:03:36.540422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1165/2294] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:03:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:03:56.887762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:03:56.898082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997aef5-ead4-4a12-8be3-d591df5e75f4 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:03:56.901718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:03:56.902441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:03:56.902921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:03:56.903200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:03:56.905147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:03:56.962298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:03:56.963656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:03:56.972540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1130/2295] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:05:36.979937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:05:36.988472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217843f9-e796-4cfb-bda6-c98da6bc4f70 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:05:36.991991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:05:36.993179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:05:36.993453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:05:36.993719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:05:37.006148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:05:37.007707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:05:37.016917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1166/2296] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:05:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:05:44.029934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:05:44.031309 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:05:44.097260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459156d-7dc7-41a8-8c30-092ebd8fe56e service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:05:44.102237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:05:44.102869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:05:44.103142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:05:44.103409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:05:44.105166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:05:44.116543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:05:44.118732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:05:44.128401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1131/2297] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:05:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:06:43.952193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:06:43.961131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43db3c8-e080-490d-a228-d3829a2c7ab8 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:06:43.965944 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:06:43.966935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:06:43.967274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:06:43.967609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:06:43.978308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:06:43.979935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:06:43.990504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1167/2298] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:06:47.058393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:06:47.070540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223b558-9c0c-471c-a363-746116a42d93 service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:06:47.075968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:06:47.076599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:06:47.076878 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:06:47.077150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:06:47.084823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:06:47.086459 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:06:47.113142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1132/2299] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:06:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:09.563821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:09.572564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc558-cb87-4932-9d60-513ba1139825 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:09.576091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:09.576707 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:09.576980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:09.577249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:09.587312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:09.588739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:09.599480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1168/2300] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:37.258896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:37.267932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c32dd-5a1e-4b5b-81b8-30af2d273489 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:37.271520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:37.272148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:37.272425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:37.272697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:37.280879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:37.282358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:37.309109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1133/2301] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:37.387934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:37.396807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100baa5-42a8-46f3-bde8-5e68ed776f48 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:37.400315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca07fd3-6d31-4406-86c4-cc2c6fb0eab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:37.400935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07fd3-6d31-4406-86c4-cc2c6fb0eab8 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:37.401206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07fd3-6d31-4406-86c4-cc2c6fb0eab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:37.401567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07fd3-6d31-4406-86c4-cc2c6fb0eab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:37.409958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca07fd3-6d31-4406-86c4-cc2c6fb0eab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:37.411388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca07fd3-6d31-4406-86c4-cc2c6fb0eab8 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:37.438351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1169/2302] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:37.695698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:37.784536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e3698-b668-4678-b4c5-6c7a7be528c5 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:37.789720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:37.790823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:37.791105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:37.791379 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] PATH_INFO: `/v3/users/39b7ce7aa84c42c0a14351feb37b4d9d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:37.793680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b7ce7aa84c42c0a14351feb37b4d9d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:37.795827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:37.842259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b7ce7aa84c42c0a14351feb37b4d9d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:37.848884 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b7ce7aa84c42c0a14351feb37b4d9d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:37.857289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b7ce7aa84c42c0a14351feb37b4d9d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:37.857936 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b7ce7aa84c42c0a14351feb37b4d9d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:37.869489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b7ce7aa84c42c0a14351feb37b4d9d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:37.875457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1134/2303] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:07:37 2022] DELETE /identity/v3/users/39b7ce7aa84c42c0a14351feb37b4d9d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:07:37.880006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:37.880297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:37.880565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:37.898042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:37.899255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:37.954960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1170/2304] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:37.965184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:37.966998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:38.022671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42190f26-d1fe-4457-ad5d-613fa1e5b9aa admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.026770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3ba30-27f0-4e1b-a6e8-248b295c93c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.027399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ba30-27f0-4e1b-a6e8-248b295c93c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.027672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ba30-27f0-4e1b-a6e8-248b295c93c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.027939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ba30-27f0-4e1b-a6e8-248b295c93c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.036654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3ba30-27f0-4e1b-a6e8-248b295c93c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.038110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3ba30-27f0-4e1b-a6e8-248b295c93c7 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.047076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1135/2305] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:38.211319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.212734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:38.225141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2653fc-b5b5-4787-9565-76553936abee None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.229731 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.231928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.232213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.232485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] PATH_INFO: `/v3/projects/513196f833e447a989898b7daee36ba3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.233872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513196f833e447a989898b7daee36ba3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.237073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.285378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513196f833e447a989898b7daee36ba3', 'request_id': 'req-623bc3d4-6b84-4b4a-ab51-481798eab173'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:38.292813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513196f833e447a989898b7daee36ba3', 'request_id': 'req-623bc3d4-6b84-4b4a-ab51-481798eab173'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:38.298278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513196f833e447a989898b7daee36ba3', 'request_id': 'req-623bc3d4-6b84-4b4a-ab51-481798eab173'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:38.309811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] The token cache is being invalidate because project 513196f833e447a989898b7daee36ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:07:38.310099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:38.310766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-623bc3d4-6b84-4b4a-ab51-481798eab173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:07:38.312324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1171/2306] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:07:38 2022] DELETE /identity/v3/projects/513196f833e447a989898b7daee36ba3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:07:38.318194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.318668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.318762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.339047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:38.340263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:38.399063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1136/2307] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:38.460112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.460715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.460885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.479687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:38.480890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:38.488762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1172/2308] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:38.492960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.503075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea0a55-5b1b-4bd3-b7da-c98d4dc37020 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.507741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.508460 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.508799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.509132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.509945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:07:38.510384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.512609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.524001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1137/2309] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:07:38.528156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.537341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7615-9ec7-4d74-a85b-60eefd9057ee None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.542109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.542763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.543042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.543309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.543988 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.545930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.584978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1173/2310] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:07:38 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:07:38.586180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.596279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1ab7-109c-4319-ab81-d91ae9f0ded9 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.665261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.665968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.666247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.667040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.667752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.669684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.691987 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1138/2311] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:07:38 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:07:38.697909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.708481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ba37-75e8-4ef7-8424-9903539c7111 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.713270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.714030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.714309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.714584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.715310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.717186 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.727274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1174/2312] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:07:38.731831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.741722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec1a1-d3af-4278-b198-5b866ec6009f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.747188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fba642-baf1-4f9a-b48d-04d5fcfc651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.747915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba642-baf1-4f9a-b48d-04d5fcfc651a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.748257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba642-baf1-4f9a-b48d-04d5fcfc651a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.748593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fba642-baf1-4f9a-b48d-04d5fcfc651a admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.749373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba642-baf1-4f9a-b48d-04d5fcfc651a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.751088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fba642-baf1-4f9a-b48d-04d5fcfc651a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.763743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1139/2313] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:07:38.767782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.778420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00682-e545-40b4-9403-3f9e33f58cd3 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.783314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.784191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.784469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.784743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] PATH_INFO: `/v3/projects/abf385fc38564b2cad6700769ec328f6/users/0af25f69aa4740e5afc8aef142d4f71c/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.800310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf385fc38564b2cad6700769ec328f6, user_id=0af25f69aa4740e5afc8aef142d4f71c, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:38.803507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:38.817517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1175/2314] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:07:38 2022] PUT /identity/v3/projects/abf385fc38564b2cad6700769ec328f6/users/0af25f69aa4740e5afc8aef142d4f71c/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:07:38.822882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.823203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.823637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:38.840739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:38.842237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:38.909343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1140/2315] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:38.920075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:38.921849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:38.991303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd6147-8980-4f3f-8698-8d84d8edd32b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:38.996655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d0a37-206f-4dfc-b657-124a8bff47f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:38.997388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0a37-206f-4dfc-b657-124a8bff47f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:38.997757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0a37-206f-4dfc-b657-124a8bff47f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:38.998159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d0a37-206f-4dfc-b657-124a8bff47f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:39.011877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d0a37-206f-4dfc-b657-124a8bff47f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:39.013609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d0a37-206f-4dfc-b657-124a8bff47f1 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:39.025122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1176/2316] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:07:39.403710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:39.405227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:39.560516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8e8f-1cad-4497-b281-33dbcb4b8969 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:39.568847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:39.569504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:39.569811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:39.570252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:39.572011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:39.589110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:39.592575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:39.604881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1141/2317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:42.474802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:42.475384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:42.475485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:42.517233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] MFA Rules not processed for user `13a6ce9b67564caab0892fc443073202`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:42.518702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:42.577868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1177/2318] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:42.710725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:42.712644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:42.727212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16a21d-4eb5-4d4d-9a2a-6bc84705df36 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:42.731328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:42.738892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:42.739200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:42.739581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:42.741637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:42.752072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:42.753712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:42.763063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1142/2319] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:43.166159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:43.177343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bceb-5c0e-48a1-95b4-2a26c7e71c24 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:43.183239 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:43.184023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:43.184395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:43.184673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:43.186992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:43.197968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:43.199417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cb671-f649-4003-821a-766bb3a30931 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:43.208066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1178/2320] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:07:43.921180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:43.923788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:44.004979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99911d-733b-421b-8b70-ab8dcd6a70cc service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:44.010760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:44.011731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:44.012013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:44.012282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:44.014881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:44.028235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:44.030319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:44.041959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1143/2321] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:45.055184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.056104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.056379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.089163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] MFA Rules not processed for user `0af25f69aa4740e5afc8aef142d4f71c`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:45.090441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:45.172392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1179/2322] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:45.176890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:45.191959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebefa-dcd3-4e40-b1cf-da34e0d95ae8 service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:45.202768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:45.203589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.203874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.204149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.205109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:45.207010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:45.256689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1144/2323] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:07:45 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:07:45.257691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:45.268772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252d211-e8e0-4d46-a7b6-75ca3db9ef6f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:45.339197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:45.339962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.340307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.340645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.341665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:45.343749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:45.377095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1180/2324] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:07:45 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:07:45.378683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:45.392426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3d7a-0813-47ee-940d-d1611b4512bb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:45.403263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:45.404572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.405016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.405439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.406363 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:45.408401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:45.435842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1145/2325] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:07:45.436862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:45.452948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877aaf-6498-45d7-b6ec-74ccda8e2e32 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:45.459923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:45.461906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.462338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.463170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] PATH_INFO: `/v3/projects/b54c0c427f9f4272859de2bf95b9b1be/users/1f196765d0cc47c9ac90b0a3e3fb081a/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.489868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54c0c427f9f4272859de2bf95b9b1be, user_id=1f196765d0cc47c9ac90b0a3e3fb081a, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:45.494029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:45.526760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1181/2326] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:07:45 2022] PUT /identity/v3/projects/b54c0c427f9f4272859de2bf95b9b1be/users/1f196765d0cc47c9ac90b0a3e3fb081a/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:07:45.527895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:45.542777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a28328-f661-4d78-8e62-743bd4d745f2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:45.621296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:45.626116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.626650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.626838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.627665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:45.629676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:45.646303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1146/2327] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:07:45.650213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:45.661139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6f52-f211-4b45-9fe5-aee82786df62 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:45.666513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f275d-70d9-4a9f-a3c6-d819e84dd22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:45.667484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f275d-70d9-4a9f-a3c6-d819e84dd22d admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:45.667755 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f275d-70d9-4a9f-a3c6-d819e84dd22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:45.668020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f275d-70d9-4a9f-a3c6-d819e84dd22d admin admin] PATH_INFO: `/v3/projects/b54c0c427f9f4272859de2bf95b9b1be/users/1f196765d0cc47c9ac90b0a3e3fb081a/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:45.670333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f275d-70d9-4a9f-a3c6-d819e84dd22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54c0c427f9f4272859de2bf95b9b1be, user_id=1f196765d0cc47c9ac90b0a3e3fb081a, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:45.673016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f275d-70d9-4a9f-a3c6-d819e84dd22d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:45.696463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1182/2328] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:07:45 2022] PUT /identity/v3/projects/b54c0c427f9f4272859de2bf95b9b1be/users/1f196765d0cc47c9ac90b0a3e3fb081a/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:07:45.872137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:46.021315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220836a7-7a70-40e8-b08b-f62332971a97 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:46.149833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:46.150445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:46.151671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:46.151671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:46.153370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:46.172338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:46.175402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:46.199163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1147/2329] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:51.887080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ead9-5f9e-4273-9fca-bdca8b072a99 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:51.887614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ead9-5f9e-4273-9fca-bdca8b072a99 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:51.887614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ead9-5f9e-4273-9fca-bdca8b072a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:51.925709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4dc8ead9-5f9e-4273-9fca-bdca8b072a99 None None] MFA Rules not processed for user `1f196765d0cc47c9ac90b0a3e3fb081a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:51.927222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4dc8ead9-5f9e-4273-9fca-bdca8b072a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:52.002898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1183/2330] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:07:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:52.016433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:52.018419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:52.078438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0ab4-51b7-4de3-93cb-644d7893f1b6 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:52.088058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:52.089556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:52.090080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:52.090350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:52.147542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:52.148998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:52.160091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1148/2331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:52.265384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:52.265794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:52.266139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:52.287773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:07:52.288979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:52.360521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1184/2332] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 17:07:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:07:52.407811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:52.409538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:52.479690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea460f9-c674-479a-a159-6551898ad794 service glance] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:52.484680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:52.485322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:52.485597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:52.485901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:52.493912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:52.495532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:52.503586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1149/2333] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:07:54.593469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:07:54.615273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbe534-afed-428c-8d95-b4748ade428f None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:07:54.634733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:07:54.636140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:07:54.636422 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:07:54.636693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:07:54.638639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:07:54.654543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:07:54.656203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7db878-0208-4f53-aa8c-563d8fafcd0e service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:07:54.676864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1185/2334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:07:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:07:59.929359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:08:00.026594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeda2f1-5236-4b40-b5cf-3ec53a074d4a service swift] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:08:00.035224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:08:00.036062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:08:00.036369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:08:00.036641 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:08:00.039541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:08:00.172577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:08:00.174187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a85ebe-4250-454d-90f6-0b2a592b7367 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:08:00.201598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1150/2335] 10.222.0.70 () {60 vars in 1396 bytes} [Mon May 16 17:07:59 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:08:02.429786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:08:02.430346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:08:02.430346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:08:02.449949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] MFA Rules not processed for user `0af25f69aa4740e5afc8aef142d4f71c`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:08:02.451140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:08:02.458068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1186/2336] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:08:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:08:04.245710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:08:04.246285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:08:04.246285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:08:04.264655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:08:04.265972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:08:04.273585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1151/2337] 10.222.0.70 () {58 vars in 1009 bytes} [Mon May 16 17:08:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:08:04.286687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:08:04.300032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960c52f-c78e-4a89-b31a-3fee588b1b2c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:08:04.306096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:08:04.307571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:08:04.307860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:08:04.308128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:08:04.319333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:08:04.320921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:08:04.329165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1187/2338] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:08:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 16 17:08:35.185858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:08:35.198273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa6cd7-05bd-4d23-9193-c98125660e51 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:08:35.204137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:08:35.204767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:08:35.205043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:08:35.205313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:08:35.207086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:08:35.281706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:08:35.283337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54def1-5b55-413d-9448-e7d98c78fbae service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:08:35.301019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1152/2339] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:08:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:09:37.790934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:09:37.792318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:09:37.872523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ea76-8e98-4f11-9352-fd457d13730c service swift] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:09:37.876154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:09:37.876787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:09:37.877067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:09:37.877342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:09:37.879278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:09:37.965899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:09:37.967924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:09:37.984910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1188/2340] 10.222.0.70 () {60 vars in 1396 bytes} [Mon May 16 17:09:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:09:58.045130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:09:58.046054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:09:58.046054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:09:58.102223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] MFA Rules not processed for user `51eb6844e80e49bbbbdeb0df5980acd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:09:58.103443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:09:58.127503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1153/2341] 10.222.0.70 () {58 vars in 967 bytes} [Mon May 16 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:09:58.175628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:09:58.213670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8ee7e-a551-4642-8771-f631a7709081 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:09:58.231473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15960410c990447c9773da8ae5be7cb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:09:58.232162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:09:58.232405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:09:58.232662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:09:58.245856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:09:58.247553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:09:58.259309 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1189/2342] 10.222.0.70 () {60 vars in 1384 bytes} [Mon May 16 17:09:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 16 17:10:06.649493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:10:06.730897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bf722-cf31-4abf-8d25-2e18c209cff4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:10:06.735419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:10:06.736864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:10:06.737140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:10:06.737411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] PATH_INFO: `/v3/users/0af25f69aa4740e5afc8aef142d4f71c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:10:06.738644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af25f69aa4740e5afc8aef142d4f71c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:10:06.741018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:10:06.788991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af25f69aa4740e5afc8aef142d4f71c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:06.795453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af25f69aa4740e5afc8aef142d4f71c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:06.803434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af25f69aa4740e5afc8aef142d4f71c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:06.804103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af25f69aa4740e5afc8aef142d4f71c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:06.815993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af25f69aa4740e5afc8aef142d4f71c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:06.822197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1154/2343] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:10:06 2022] DELETE /identity/v3/users/0af25f69aa4740e5afc8aef142d4f71c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:10:06.995392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:10:07.011868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb83a6-5af8-4abc-b37d-03e869a6551c service swift] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:10:07.067047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:10:07.067936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:10:07.068213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:10:07.068485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] PATH_INFO: `/v3/projects/abf385fc38564b2cad6700769ec328f6` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:10:07.069690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf385fc38564b2cad6700769ec328f6)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:10:07.071650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:10:07.117330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf385fc38564b2cad6700769ec328f6', 'request_id': 'req-7d817335-3761-4876-b6ae-58c7ec590429'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.124254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf385fc38564b2cad6700769ec328f6', 'request_id': 'req-7d817335-3761-4876-b6ae-58c7ec590429'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.129529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf385fc38564b2cad6700769ec328f6', 'request_id': 'req-7d817335-3761-4876-b6ae-58c7ec590429'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.152224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] The token cache is being invalidate because project abf385fc38564b2cad6700769ec328f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:10:07.152507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.153126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.154815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1190/2344] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:10:06 2022] DELETE /identity/v3/projects/abf385fc38564b2cad6700769ec328f6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:10:07.159451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:10:07.160885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:10:07.173684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5fd63-a899-4fac-82dc-0e60d9b52e63 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:10:07.227209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:10:07.228074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:10:07.228346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:10:07.228612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] PATH_INFO: `/v3/users/1f196765d0cc47c9ac90b0a3e3fb081a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:10:07.229845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f196765d0cc47c9ac90b0a3e3fb081a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:10:07.231782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:10:07.275977 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f196765d0cc47c9ac90b0a3e3fb081a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.282565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f196765d0cc47c9ac90b0a3e3fb081a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.290198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f196765d0cc47c9ac90b0a3e3fb081a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.290768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f196765d0cc47c9ac90b0a3e3fb081a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.302029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f196765d0cc47c9ac90b0a3e3fb081a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.308048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1155/2345] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:10:07 2022] DELETE /identity/v3/users/1f196765d0cc47c9ac90b0a3e3fb081a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:10:07.520635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:10:07.522099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:10:07.535476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d817335-3761-4876-b6ae-58c7ec590429 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:10:07.591938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:10:07.592801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:10:07.593077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:10:07.593347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] PATH_INFO: `/v3/projects/b54c0c427f9f4272859de2bf95b9b1be` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:10:07.594559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54c0c427f9f4272859de2bf95b9b1be)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:10:07.597022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:10:07.643531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54c0c427f9f4272859de2bf95b9b1be', 'request_id': 'req-763c2e36-9d84-4621-b882-62da9dfe621b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.650278 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54c0c427f9f4272859de2bf95b9b1be', 'request_id': 'req-763c2e36-9d84-4621-b882-62da9dfe621b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.655769 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54c0c427f9f4272859de2bf95b9b1be', 'request_id': 'req-763c2e36-9d84-4621-b882-62da9dfe621b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.666826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] The token cache is being invalidate because project b54c0c427f9f4272859de2bf95b9b1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:10:07.667110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.667747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:10:07.669282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1191/2346] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:10:07 2022] DELETE /identity/v3/projects/b54c0c427f9f4272859de2bf95b9b1be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:10:53.019780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:10:53.021225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:10:53.106542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931eb5-64e5-40c4-9dd8-b9661978806e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:10:53.161329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:10:53.161986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:10:53.162262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:10:53.162526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:10:53.164261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:10:53.174815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:10:53.176370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:10:53.185649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1156/2347] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:11:43.834493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:11:43.835922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:11:43.912101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2e36-9d84-4621-b882-62da9dfe621b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:11:43.915764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:11:43.916400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:11:43.916679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:11:43.916948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:11:43.920208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:11:44.000405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:11:44.001847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:11:44.020763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1192/2348] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:11:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:11:57.628617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:11:57.630087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:11:57.710980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24474c1f-c007-4786-baf4-be5aa698b287 service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:11:57.714964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:11:57.717110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:11:57.717110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:11:57.717110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:11:57.718232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:11:57.787373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:11:57.789084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:11:57.798696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1157/2349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:11:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:12:09.831121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:12:09.832753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:12:09.843221 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d96c-bda9-4d56-ad96-9fd7e2f493f7 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:12:09.846770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:12:09.847387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:12:09.847661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:12:09.847927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:12:09.849587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:12:09.864556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:12:09.867041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:12:09.878705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1193/2350] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:12:37.086391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:12:37.087806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:12:37.103399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfe548-9d4d-4792-8fcf-01402df2fb0e service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:12:37.108859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:12:37.109495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:12:37.109806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:12:37.110086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:12:37.111805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:12:37.180959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:12:37.182609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:12:37.191904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1158/2351] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:12:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:12:50.772444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:12:50.780899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76839346-d4ee-4e5e-ad49-8b65172be8eb service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:12:50.784535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:12:50.785168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:12:50.785448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:12:50.785722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:12:50.787500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:12:50.796541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:12:50.798514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:12:50.806255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1194/2352] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:12:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:12:59.140296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:12:59.149213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433cd17-3780-4597-b232-046adc8cf047 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:12:59.152756 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:12:59.153383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:12:59.153655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:12:59.153952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:12:59.155736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:12:59.211157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:12:59.212575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:12:59.221773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1159/2353] 10.222.0.70 () {60 vars in 1396 bytes} [Mon May 16 17:12:59 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:13:35.847461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:35.860175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c7888-51b4-4e43-a07b-9b1c16d336e9 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:35.865965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:35.866592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:35.866868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:35.867134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:35.868892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:35.924172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:35.925817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:35.934672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1195/2354] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:13:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:13:39.391126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:39.392519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:39.403501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237077de-e422-482f-aa86-2237ed0b5708 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:39.407734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:39.408365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:39.408640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:39.408910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:39.410690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:39.465507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:39.466959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:39.476243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1160/2355] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:13:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:13:40.766645 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:40.768106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:40.782062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa024b-e385-46ce-b598-baea3df844c6 service nova] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:40.787609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:40.788245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:40.788526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:40.788801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:40.790554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:40.802922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:40.804519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:40.815649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1196/2356] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:13:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:13:47.797625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:47.806868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18519-6349-4719-87da-1ef43d8a416e service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:47.810667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:47.811476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:47.811788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:47.812064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:47.813953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:47.874099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:47.875577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:47.884811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1161/2357] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:13:54.666886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:54.668325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:54.681435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ea08-3a3e-455a-aa0b-1f66aa759bb7 service nova] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:54.686056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:54.687446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:54.687724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:54.687994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] PATH_INFO: `/v3/users/e0f8b3570fb544c7be48b4bc3401e780` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:54.689224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f8b3570fb544c7be48b4bc3401e780)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:54.691176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:54.736522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f8b3570fb544c7be48b4bc3401e780'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:54.743013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f8b3570fb544c7be48b4bc3401e780'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:54.750673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f8b3570fb544c7be48b4bc3401e780'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:54.762035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f8b3570fb544c7be48b4bc3401e780'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:54.762658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f8b3570fb544c7be48b4bc3401e780'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:54.768967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1197/2358] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:13:54 2022] DELETE /identity/v3/users/e0f8b3570fb544c7be48b4bc3401e780 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:13:54.938187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:54.948246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9d938-7dea-45a5-a0a5-01760e410982 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:55.002513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:55.003359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:55.003628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:55.003892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] PATH_INFO: `/v3/projects/55fbe5576de844559b26175408f40f3f` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:55.005044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fbe5576de844559b26175408f40f3f)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:55.006986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:55.049778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fbe5576de844559b26175408f40f3f', 'request_id': 'req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.056408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fbe5576de844559b26175408f40f3f', 'request_id': 'req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.062837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fbe5576de844559b26175408f40f3f', 'request_id': 'req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.074195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] The token cache is being invalidate because project 55fbe5576de844559b26175408f40f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:13:55.074493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.075158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.076745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1162/2359] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:13:54 2022] DELETE /identity/v3/projects/55fbe5576de844559b26175408f40f3f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:13:55.080666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:55.082179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:55.096372 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d964f-57c3-45a2-b81b-85f2a3ffe913 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:55.156266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:55.157146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:55.157420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:55.157688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] PATH_INFO: `/v3/users/ea822aca1f9d4ddaa081a86b2e9403c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:55.173782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea822aca1f9d4ddaa081a86b2e9403c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:55.176099 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:55.220900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea822aca1f9d4ddaa081a86b2e9403c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.228396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea822aca1f9d4ddaa081a86b2e9403c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.235637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea822aca1f9d4ddaa081a86b2e9403c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.247360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea822aca1f9d4ddaa081a86b2e9403c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.247990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea822aca1f9d4ddaa081a86b2e9403c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.254358 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1198/2360] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:13:55 2022] DELETE /identity/v3/users/ea822aca1f9d4ddaa081a86b2e9403c4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:13:55.428342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:13:55.429836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:13:55.443180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5513c-6405-4ca2-9fb2-e2590a0a4592 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:13:55.514871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:13:55.515754 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:13:55.516030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:13:55.516299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] PATH_INFO: `/v3/projects/4054a926c7484734914d42c8f7f48991` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:13:55.527226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4054a926c7484734914d42c8f7f48991)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:13:55.529265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:13:55.574132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4054a926c7484734914d42c8f7f48991', 'request_id': 'req-daec70c3-47dc-47eb-b34d-bd56c643adea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.581796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4054a926c7484734914d42c8f7f48991', 'request_id': 'req-daec70c3-47dc-47eb-b34d-bd56c643adea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.587031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4054a926c7484734914d42c8f7f48991', 'request_id': 'req-daec70c3-47dc-47eb-b34d-bd56c643adea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.599150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] The token cache is being invalidate because project 4054a926c7484734914d42c8f7f48991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:13:55.599472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.600061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:13:55.601674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1163/2361] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:13:55 2022] DELETE /identity/v3/projects/4054a926c7484734914d42c8f7f48991 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:15:39.770396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:15:39.772016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:15:39.833507 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6425-d947-4866-8400-a2b8ee02e3b4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:15:39.880623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:15:39.881274 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:15:39.881575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:15:39.882489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:15:39.884280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:15:39.940031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:15:39.941411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:15:39.950825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1199/2362] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:15:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:15:55.304696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:15:55.306167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:15:55.392190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec70c3-47dc-47eb-b34d-bd56c643adea admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:15:55.397151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:15:55.397829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:15:55.398108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:15:55.398373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:15:55.400158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:15:55.412012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:15:55.414304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:15:55.424606 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1164/2363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:16:45.465853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:16:45.467236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:16:45.521254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd4e12-4a0e-49ca-86c9-a9fda7501959 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:16:45.525522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:16:45.526194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:16:45.526468 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:16:45.526734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:16:45.528471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:16:45.597616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:16:45.599102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:16:45.610504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1200/2364] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:16:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:16:56.085246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:16:56.086951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:16:56.101629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b232db-30d7-4a0a-9575-fb7a1c3848b1 service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:16:56.107059 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:16:56.107699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:16:56.107976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:16:56.108250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:16:56.110054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:16:56.176659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:16:56.178441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:16:56.197056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1165/2365] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:17:08.197202 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:17:08.198737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:17:08.209822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79b6e-4f91-49f6-8008-e608e481611d service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:17:08.214106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:17:08.214741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:17:08.215017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:17:08.215286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:17:08.217017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:17:08.230263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:17:08.231691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:17:08.242948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1201/2366] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:17:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:17:40.356831 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:17:40.358265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:17:40.369413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985af0-2da6-48e7-a2ea-58ceb8725ab5 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:17:40.372946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:17:40.373572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:17:40.373890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:17:40.374163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:17:40.375834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:17:40.443291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:17:40.444728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:17:40.462753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1166/2367] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:17:55.732898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:17:55.741207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8fac9-a25f-41ed-bab4-4da5a8093435 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:17:55.745403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:17:55.746081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:17:55.746356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:17:55.746624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:17:55.748491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:17:55.757657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:17:55.759108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:17:55.766714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1202/2368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:17:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:39.910760 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:39.949978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbfda2-2a5c-4fef-8484-f10ee4af02b1 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:39.955875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:39.956649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:39.957018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:39.957392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:39.959675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:40.010678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:19:40.012506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:19:40.024908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1167/2369] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:40.717467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:40.747742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8957d90-6523-4fe5-8e05-40aafeafea56 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:40.763788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:40.764760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:40.765218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:40.765648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:40.767547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:40.856562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:19:40.858076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c9454-8229-47f4-a130-8d92c8e1d55e service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:19:40.878120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1203/2370] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:40.930922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:40.941073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39519c3-4dba-4aae-8f20-5232757d6cfb service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:40.945182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:40.946337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:40.946953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:40.947380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:40.949330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:41.063397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:19:41.065655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:19:41.090184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1168/2371] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:41.605231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:41.605644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:41.606040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:41.631145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] MFA Rules not processed for user `58633f982d3840dd88f631bcee882f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:19:41.632416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:41.639764 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1204/2372] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:19:41.939327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:41.948563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffe6d5-1a9b-4e7b-823b-56f9e69b0fc8 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:41.952106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:41.952722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:41.952998 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:41.953265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:41.955053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:41.965012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:19:41.966530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:19:41.974115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1169/2373] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:43.559550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:43.571232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4c75a-a477-4f2d-af80-a1a416e65191 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:43.577344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:43.578033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:43.578346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:43.578619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:43.580417 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:43.592784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:19:43.594460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:19:43.604882 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1205/2374] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:55.477922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:55.479445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:55.495428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24db094-842b-45ea-a174-10937324f16e service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:55.500848 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:55.501489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:55.501789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:55.502064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:55.503807 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:55.515719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:19:55.517308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:19:55.528217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1170/2375] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:19:59.223003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:19:59.225032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:59.239511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b54f7-35dc-46b5-9509-11d46106d0a3 service placement] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:19:59.243815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:19:59.244832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:19:59.247921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:19:59.248238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:19:59.250192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] Could not find project: 55fbe5576de844559b26175408f40f3f.: keystone.exception.ProjectNotFound: Could not find project: 55fbe5576de844559b26175408f40f3f. May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application Traceback (most recent call last): May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 16 17:19:59.291864 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:19:59.293259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self._validate_token_resources() May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 16 17:19:59.294585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.get_or_create( May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application with Lock( May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._enter() May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.creator() May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application created_value = creator( May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 16 17:19:59.295832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 16 17:19:59.297040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 55fbe5576de844559b26175408f40f3f. May 16 17:19:59.297040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: ERROR keystone.server.flask.application May 16 17:19:59.297040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1206/2376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:19:59 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 16 17:20:01.743933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:20:01.775199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778ad1a-c4ca-4ec4-8867-511fcbc13721 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:20:01.784072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:20:01.784739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:20:01.785024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:20:01.785296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:20:01.787367 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:20:01.819618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:20:01.821334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:20:01.834418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1171/2377] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:20:40.694624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:20:40.708848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02897a-33fa-44d7-b57a-88b951def093 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:20:40.715329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:20:40.716129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:20:40.716444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:20:40.716771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:20:40.727331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:20:40.729264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:20:40.758826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1207/2378] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:20:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:21:01.055485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:21:01.076599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c768fc-56e4-4e87-8f84-349c6f41f618 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:21:01.081613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:21:01.082272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:21:01.082803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:21:01.083074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:21:01.091849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:21:01.093426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:21:01.102834 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1172/2379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:21:45.181342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:21:45.200577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6950a8d-881a-4fd7-95f1-3afd09b628de service nova] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:21:45.204573 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:21:45.205206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:21:45.205485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:21:45.205775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:21:45.216108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:21:45.217549 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:21:45.238332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1208/2380] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:21:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:22:01.841115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:22:01.858500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42f2fa-4ef5-4d93-abb8-7b99c4e0f34f service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:22:01.862103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:22:01.862726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:22:01.862996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:22:01.863259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:22:01.871347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:22:01.872759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:22:01.882003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1173/2381] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:22:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:22:08.393586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:22:08.404803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2802d81-d05a-45ec-8e12-f4e90a8d792d service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:22:08.409254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:22:08.409933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:22:08.410215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:22:08.410490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:22:08.422397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:22:08.423919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:22:08.435293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1209/2382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:22:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:22:41.270855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:22:41.284103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15645128-7450-4f29-b02e-96d7a6dcb1d3 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:22:41.290561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:22:41.291193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:22:41.291472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:22:41.291744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:22:41.300588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:22:41.302382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:22:41.312450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1174/2383] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:22:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:23:01.664689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:23:01.674897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83682609-c1f9-4033-bb3d-906d7074fa04 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:23:01.679168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:23:01.679821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:23:01.680102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:23:01.680368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:23:01.692175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:23:01.693634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:23:01.702318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1210/2384] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:23:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:24:02.280684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:02.290358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83f9e-aa99-4bf5-bb7b-a0b7e0d9e278 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:02.294835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:02.295481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:02.295761 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:02.296034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:02.297986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:24:02.380960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:02.382461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:02.402101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1175/2385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:24:06.005294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.006748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:24:06.026060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d20f3-0987-4dc9-bb7f-19a959e69e27 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.031113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.032260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.032537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.032808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] PATH_INFO: `/v3/users/13a6ce9b67564caab0892fc443073202` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.034071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a6ce9b67564caab0892fc443073202)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.036014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.080833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a6ce9b67564caab0892fc443073202'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.088460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a6ce9b67564caab0892fc443073202'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.095756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a6ce9b67564caab0892fc443073202'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.107925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a6ce9b67564caab0892fc443073202'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.108511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-dfdca8c9-198a-41d5-b2eb-94aa2f522fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a6ce9b67564caab0892fc443073202'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.114299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1211/2386] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:24:06 2022] DELETE /identity/v3/users/13a6ce9b67564caab0892fc443073202 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:24:06.287921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.300199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8bde8-86b0-4425-bc64-1c6522a25c9f service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.355151 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.356048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.356837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.357105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] PATH_INFO: `/v3/projects/43c36b17e1414e208b453d10be94834c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.358353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c36b17e1414e208b453d10be94834c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.360224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.404287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c36b17e1414e208b453d10be94834c', 'request_id': 'req-92e0805c-2807-423d-b62b-9647159b8d36'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.414433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c36b17e1414e208b453d10be94834c', 'request_id': 'req-92e0805c-2807-423d-b62b-9647159b8d36'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.422408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c36b17e1414e208b453d10be94834c', 'request_id': 'req-92e0805c-2807-423d-b62b-9647159b8d36'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.433308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] The token cache is being invalidate because project 43c36b17e1414e208b453d10be94834c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:24:06.433592 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.434408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-92e0805c-2807-423d-b62b-9647159b8d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:24:06.435875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1176/2387] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:24:06 2022] DELETE /identity/v3/projects/43c36b17e1414e208b453d10be94834c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:24:06.441621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.441934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.442215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.496136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:24:06.497323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:24:06.553657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1212/2388] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:24:06.561386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.561759 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.562147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.580723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:24:06.581942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:24:06.589810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1177/2389] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:24:06.594534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.603908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ed76f-1393-4d26-ac85-f7cd09f3dfae None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.609163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.609757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.610045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.610317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.611028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:24:06.611330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.612925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.624354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1213/2390] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:24:06.628300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.638075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a5f43-5de0-4c81-8be8-65940435c70e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.642745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.643391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.643662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.643930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.644610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.646911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.681299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1178/2391] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:24:06 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:24:06.685416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.695269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d3a2-eb6a-4b64-913d-02b72aa9b2a9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.753297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.753981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.754255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.754521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.755193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.757116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.775740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1214/2392] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:24:06 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:24:06.780399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.790545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0684b-b255-4361-943b-415deb2c52a4 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.795122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.795769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.796042 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.796310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.797032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.798680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.813014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1179/2393] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:24:06.817047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.827428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78060023-73a4-4e8c-9fbd-6424050e3c0c admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.832383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e31c5-8a7a-4f17-9310-ed21a32bc30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.833035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e31c5-8a7a-4f17-9310-ed21a32bc30d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.833313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e31c5-8a7a-4f17-9310-ed21a32bc30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.833588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e31c5-8a7a-4f17-9310-ed21a32bc30d admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.834384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e31c5-8a7a-4f17-9310-ed21a32bc30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.835989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e31c5-8a7a-4f17-9310-ed21a32bc30d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.846207 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1215/2394] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:24:06.850580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:06.861086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1ef2c-af02-44d3-b6d5-b0b477a5df90 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:06.866314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:06.867190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.867463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.867732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] PATH_INFO: `/v3/projects/96bd5598466d47718e0a2522d2211d2b/users/bd8cf7b9f208496f9fc4b74199a82c59/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.882123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bd5598466d47718e0a2522d2211d2b, user_id=bd8cf7b9f208496f9fc4b74199a82c59, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:06.884798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:06.898125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1180/2395] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:24:06 2022] PUT /identity/v3/projects/96bd5598466d47718e0a2522d2211d2b/users/bd8cf7b9f208496f9fc4b74199a82c59/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:24:06.909110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:06.909399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:06.909696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:06.935516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] MFA Rules not processed for user `bd8cf7b9f208496f9fc4b74199a82c59`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:24:06.936741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:24:07.007070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1216/2396] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:24:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:24:07.018816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:24:07.020512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:24:07.106362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19546b-811d-4b22-909b-7f17b8b163ec admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:24:07.112074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:24:07.112665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:24:07.112945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:24:07.113214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:24:07.120920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:24:07.123065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:24:07.131801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1181/2397] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:24:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:26:02.554714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.556119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:02.622375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca347-c688-4dfd-89f9-834cc6ce5eb0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.625892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.626521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.626795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.627063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.628793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:02.695210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.696575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.705922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1217/2398] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:02.787116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:02.795925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1157b-292b-4e41-bd36-0f573ccd5590 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:02.799487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:02.800110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:02.800385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:02.800655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:02.802421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:02.857852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:02.859290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:02.867953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1182/2399] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:03.063251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:03.064663 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:03.162620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cea7f-a178-4421-a003-83de9f99532a service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:03.168150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:03.170006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:03.170291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:03.170593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:03.172410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:03.185206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:03.187124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4c716-a748-45d8-ae13-33f11c0c20d0 service placement] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:03.197351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1218/2400] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:04.798793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:04.801721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:04.820267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd74053-39f8-4a5a-a427-7f5430c810c6 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:04.829237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:04.830387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:04.830903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:04.831407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:04.833914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:04.849779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:04.852005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:04.865913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1183/2401] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:06.951209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:06.952327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:06.953061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:06.996110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] MFA Rules not processed for user `189966fbd18f4152b6b54ba5492034e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:06.997329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.070186 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1219/2402] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:07.453544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:07.455088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.525233 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514f24f-c390-4607-a3e1-044316258dcc service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:07.529495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:07.530184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.530471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.530719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.532645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.543312 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:07.544862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:07.553593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1184/2403] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:26:07.874396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:07.875892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.891828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f76d3-7a07-4bd5-972a-c4bcf059b5ab None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:07.896853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:07.897495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:07.897805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:07.898083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:07.899836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:07.912231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:07.913861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:07.923903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1220/2404] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:08.200217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:08.201624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:08.212391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c90ed-2ec9-4115-b5d9-4eccea10a5d4 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:08.216350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:08.217068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:08.217415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:08.217682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:08.219471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:08.282700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:08.284087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:08.294782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1185/2405] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:12.498407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.499841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:12.518473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61472-c443-4dfc-a3ec-fac4a7e206f5 service placement] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.523315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.524179 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.524451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.524714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] PATH_INFO: `/v3/users/673ff42fb9454adf93be94f46e60755a` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.525945 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673ff42fb9454adf93be94f46e60755a)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.528529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.580685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673ff42fb9454adf93be94f46e60755a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.587575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673ff42fb9454adf93be94f46e60755a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.596271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673ff42fb9454adf93be94f46e60755a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.609828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673ff42fb9454adf93be94f46e60755a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.611073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-09bb1314-8325-40eb-aef4-501fe543b1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673ff42fb9454adf93be94f46e60755a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.617306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1221/2406] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:26:12 2022] DELETE /identity/v3/users/673ff42fb9454adf93be94f46e60755a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:12.851515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:12.862731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade56cb2-94af-475f-aa04-a372c01b06d5 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:12.919058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:12.919922 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:12.920202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:12.920478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] PATH_INFO: `/v3/projects/d288b61a6379415c9f773fc61950f570` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:12.921677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d288b61a6379415c9f773fc61950f570)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:12.923691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:12.968978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd288b61a6379415c9f773fc61950f570', 'request_id': 'req-a1be5f94-f54e-4a2e-877d-791b43a3e123'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.976159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd288b61a6379415c9f773fc61950f570', 'request_id': 'req-a1be5f94-f54e-4a2e-877d-791b43a3e123'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.981653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd288b61a6379415c9f773fc61950f570', 'request_id': 'req-a1be5f94-f54e-4a2e-877d-791b43a3e123'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.992518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] The token cache is being invalidate because project d288b61a6379415c9f773fc61950f570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:26:12.992912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.993544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a1be5f94-f54e-4a2e-877d-791b43a3e123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:12.995109 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1186/2407] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:26:12 2022] DELETE /identity/v3/projects/d288b61a6379415c9f773fc61950f570 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:13.001923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.002214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.002494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.020974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:13.022271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:13.086776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1222/2408] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:13.096452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.096763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.097023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.116310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:13.117505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:13.126265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1187/2409] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:26:13.130424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.140117 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dc498-15f9-495e-99d2-cbc8f84c5923 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.144834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.145479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.145779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.146056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.146770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:13.147074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.148690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.160177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1223/2410] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:13.164196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.174050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd39ae5-ddd0-42d2-b7e2-24d4950ff3e3 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.178954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.179598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.179899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.180169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.180851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.182900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.207488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1188/2411] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:26:13 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:13.211331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.221053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578352-8c39-437c-a461-c912d81efbbc admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.275811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.276403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.276720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.276992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.277671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.279635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.300192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1224/2412] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:26:13 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:13.303995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.314762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143d316-6c10-4e9d-9c2f-0cf3198685d3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.319502 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.320123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.320396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.320659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.321407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.323036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.333374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1189/2413] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:26:13.337304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.347728 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020ceec-83e0-49ef-afd5-de2fbf0208de admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.352301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e573ed9-8f31-44a1-afcc-6f8f6d17d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.352952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e573ed9-8f31-44a1-afcc-6f8f6d17d5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.353263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e573ed9-8f31-44a1-afcc-6f8f6d17d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.353569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e573ed9-8f31-44a1-afcc-6f8f6d17d5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.354523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e573ed9-8f31-44a1-afcc-6f8f6d17d5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.356648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e573ed9-8f31-44a1-afcc-6f8f6d17d5e7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.367036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1225/2414] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:26:13.371772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.381795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5789b-8e97-4d41-88a3-e5eb5cd160b8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.386529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.387405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.387698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.387959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] PATH_INFO: `/v3/projects/8f83c6b4fee5496697c069cf4c873cdd/users/e985adcaab2c4ee7a489fe22aedac6ea/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.402567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f83c6b4fee5496697c069cf4c873cdd, user_id=e985adcaab2c4ee7a489fe22aedac6ea, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.408550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.423737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1190/2415] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:26:13 2022] PUT /identity/v3/projects/8f83c6b4fee5496697c069cf4c873cdd/users/e985adcaab2c4ee7a489fe22aedac6ea/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:13.428903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a754a-efdc-4aa3-ad87-0cb3fb548744 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.429170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a754a-efdc-4aa3-ad87-0cb3fb548744 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.429474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a754a-efdc-4aa3-ad87-0cb3fb548744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.449374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-db8a754a-efdc-4aa3-ad87-0cb3fb548744 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:13.450643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-db8a754a-efdc-4aa3-ad87-0cb3fb548744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:13.517451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1226/2416] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:13.527571 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:13.529472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:13.588192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc810fcf-e3ca-4317-ac1b-98edc945a735 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:13.592013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:13.592660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:13.592938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:13.593212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:13.602346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:13.603785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:13.612940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1191/2417] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:14.268064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.268370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.268653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.295055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] MFA Rules not processed for user `e985adcaab2c4ee7a489fe22aedac6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:14.296255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:14.358983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1227/2418] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:14.363187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.372898 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7acaf-5aa4-463f-a32b-706b1fa8d9b0 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.377461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.378311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.378589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.378858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.379547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.381522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.406708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1192/2419] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:26:14 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:14.410745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.422057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03811e4-0608-4b21-a3a9-d81b0e2a67db None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.476131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.476793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.477067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.477339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.478054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.480538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.507114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1228/2420] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:26:14 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:14.511404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.521407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d305f7-99c4-4727-8594-c3c531eb732e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.525970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.527156 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.527435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.527725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.528433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.530102 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.542014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1193/2421] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:26:14.546845 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.556655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a1637-5e67-45e5-939c-451cfdbe10c8 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.561579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.562513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.562794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.563067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] PATH_INFO: `/v3/projects/6ae0811bc82140609d92530560214bac/users/b792cf00e9ce402f88412cacabdc22cf/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.578234 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae0811bc82140609d92530560214bac, user_id=b792cf00e9ce402f88412cacabdc22cf, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.580923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.595167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1229/2422] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:26:14 2022] PUT /identity/v3/projects/6ae0811bc82140609d92530560214bac/users/b792cf00e9ce402f88412cacabdc22cf/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:14.599154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.609009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117c012-9bff-4cb2-8b69-f0032cee649a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.663990 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae73a23-0ff5-4664-8cdf-00c4217fc1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.664644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73a23-0ff5-4664-8cdf-00c4217fc1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.664917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73a23-0ff5-4664-8cdf-00c4217fc1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.665186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73a23-0ff5-4664-8cdf-00c4217fc1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.665930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae73a23-0ff5-4664-8cdf-00c4217fc1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.667744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae73a23-0ff5-4664-8cdf-00c4217fc1d1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.677133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1194/2423] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:26:14.681424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:14.691409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4d71-4901-4d6f-a7a0-3cf9bc4a0ee9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:14.696013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:14.696872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:14.697146 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:14.697415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] PATH_INFO: `/v3/projects/6ae0811bc82140609d92530560214bac/users/b792cf00e9ce402f88412cacabdc22cf/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:14.699892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae0811bc82140609d92530560214bac, user_id=b792cf00e9ce402f88412cacabdc22cf, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:14.702967 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:14.712672 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1230/2424] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:26:14 2022] PUT /identity/v3/projects/6ae0811bc82140609d92530560214bac/users/b792cf00e9ce402f88412cacabdc22cf/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:15.375070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.375649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.375649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.403560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] MFA Rules not processed for user `b792cf00e9ce402f88412cacabdc22cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:15.405640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:15.479541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1195/2425] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:15.740625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:15.742492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:15.823188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d234c-e454-404e-bc52-5ea0552a5a0d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:15.830449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:15.831445 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:15.831904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:15.832368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:15.834790 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:15.850592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:15.852237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:15.866666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1231/2426] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:16.621116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:16.683743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025e74c-65aa-4a73-9884-36435c7ed8b4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:16.688368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:16.689224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:16.689497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:16.689786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] PATH_INFO: `/v3/users/e985adcaab2c4ee7a489fe22aedac6ea` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:16.690954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e985adcaab2c4ee7a489fe22aedac6ea)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:16.692885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:16.741000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e985adcaab2c4ee7a489fe22aedac6ea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:16.748047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e985adcaab2c4ee7a489fe22aedac6ea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:16.755093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e985adcaab2c4ee7a489fe22aedac6ea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:16.755741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e985adcaab2c4ee7a489fe22aedac6ea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:16.767516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e985adcaab2c4ee7a489fe22aedac6ea'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:16.773141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1196/2427] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:26:16 2022] DELETE /identity/v3/users/e985adcaab2c4ee7a489fe22aedac6ea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:16.944307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:16.960843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da82c6-bdd4-4aa9-9d0c-75eea38331fb service nova] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.022504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.023351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.023621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.023893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] PATH_INFO: `/v3/projects/8f83c6b4fee5496697c069cf4c873cdd` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.025183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f83c6b4fee5496697c069cf4c873cdd)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.027607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.071175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f83c6b4fee5496697c069cf4c873cdd', 'request_id': 'req-81c37b52-dde9-4b98-956d-b8c8ab4e0945'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.082407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f83c6b4fee5496697c069cf4c873cdd', 'request_id': 'req-81c37b52-dde9-4b98-956d-b8c8ab4e0945'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.088182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f83c6b4fee5496697c069cf4c873cdd', 'request_id': 'req-81c37b52-dde9-4b98-956d-b8c8ab4e0945'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.098712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] The token cache is being invalidate because project 8f83c6b4fee5496697c069cf4c873cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:26:17.098992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.099607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.101134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1232/2428] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:26:16 2022] DELETE /identity/v3/projects/8f83c6b4fee5496697c069cf4c873cdd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:17.105594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.107021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:17.119681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60bdbb-68be-4c79-bdee-524595b068f6 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.177926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.178983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.179355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.179971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] PATH_INFO: `/v3/users/b792cf00e9ce402f88412cacabdc22cf` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.181028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b792cf00e9ce402f88412cacabdc22cf)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.183865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.228492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b792cf00e9ce402f88412cacabdc22cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.235742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b792cf00e9ce402f88412cacabdc22cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.242532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b792cf00e9ce402f88412cacabdc22cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.243136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b792cf00e9ce402f88412cacabdc22cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.254122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e38abcbd-e0b3-4d81-aa3d-3c76e37da515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b792cf00e9ce402f88412cacabdc22cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.259864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1197/2429] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:26:17 2022] DELETE /identity/v3/users/b792cf00e9ce402f88412cacabdc22cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:17.510580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.512448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:17.526968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c37b52-dde9-4b98-956d-b8c8ab4e0945 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.602588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.603454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.603733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.604006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] PATH_INFO: `/v3/projects/6ae0811bc82140609d92530560214bac` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.605215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae0811bc82140609d92530560214bac)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.607205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.654971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae0811bc82140609d92530560214bac', 'request_id': 'req-0b49cab5-273d-4de6-834f-6d7fbaa80145'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.661691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae0811bc82140609d92530560214bac', 'request_id': 'req-0b49cab5-273d-4de6-834f-6d7fbaa80145'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.667633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae0811bc82140609d92530560214bac', 'request_id': 'req-0b49cab5-273d-4de6-834f-6d7fbaa80145'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.679327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] The token cache is being invalidate because project 6ae0811bc82140609d92530560214bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:26:17.679605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.680313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b49cab5-273d-4de6-834f-6d7fbaa80145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:26:17.682455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1233/2430] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:26:17 2022] DELETE /identity/v3/projects/6ae0811bc82140609d92530560214bac => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:17.687329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f262771-0c41-4358-940c-62d27248e676 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.687840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f262771-0c41-4358-940c-62d27248e676 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.688001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f262771-0c41-4358-940c-62d27248e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.706673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5f262771-0c41-4358-940c-62d27248e676 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:17.707945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5f262771-0c41-4358-940c-62d27248e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:17.768482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1198/2431] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:17.776388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.777307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.777636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.797107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:17.798345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:17.806291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1234/2432] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:26:17.810319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f262771-0c41-4358-940c-62d27248e676 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.820017 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f262771-0c41-4358-940c-62d27248e676 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.826098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.826783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.827065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.827341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.828329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:26:17.828635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.830299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.842409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1199/2433] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:26:17.846717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.855995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b9133-b640-4bcb-9850-676b909ef801 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.861374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.862096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.862375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.862666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.863382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.865381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.892135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1235/2434] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:26:17 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:17.896258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:17.906642 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25fe4-d81e-433d-a191-21ef64197199 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:17.962561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:17.963140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:17.963423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:17.963694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:17.964483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:17.966467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:17.990510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1200/2435] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:26:17 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:17.991670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.002504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed876ba-4e94-44ac-8f1d-80af530790e2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.007479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.008136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.008440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.008713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.009452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.011718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.022381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1236/2436] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:26:18.026466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.036075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3e3d-dedc-4a82-b8ce-03bbfbdc28b1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.040564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0489-149f-435f-a5c5-0c0fad350fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.041246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0489-149f-435f-a5c5-0c0fad350fad admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.041520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0489-149f-435f-a5c5-0c0fad350fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.041814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0489-149f-435f-a5c5-0c0fad350fad admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.042532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb0489-149f-435f-a5c5-0c0fad350fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.044138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb0489-149f-435f-a5c5-0c0fad350fad admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.056803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1201/2437] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:26:18.058576 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.068585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb572e73-09a6-4e1a-9942-e1b45a73a1b9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.075403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.076348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.076693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.077024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] PATH_INFO: `/v3/projects/efacce8fbba14ac081a71578d95eadf5/users/bed6cf8a538545709187e92ea0d33846/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.094149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efacce8fbba14ac081a71578d95eadf5, user_id=bed6cf8a538545709187e92ea0d33846, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.096860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.109404 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1237/2438] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:26:18 2022] PUT /identity/v3/projects/efacce8fbba14ac081a71578d95eadf5/users/bed6cf8a538545709187e92ea0d33846/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:26:18.120049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.120897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.121177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.148481 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] MFA Rules not processed for user `bed6cf8a538545709187e92ea0d33846`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:18.149695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.210931 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1202/2439] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:26:18.215639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.275341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34a099-8563-4771-9ad3-0fd80829714a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.280095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.280760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.281042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.281305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.282080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.283957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.309333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1238/2440] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:18.313352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.324225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7c7c-7e34-497a-a293-bca29e78d21e None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.381968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.383106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.383985 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.384110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.385135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.387285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.407696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1203/2441] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:26:18.413388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.427522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c1bd-9d35-4e5d-a29f-1d1db4a363dd admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.432227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.433441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.433724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.434029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.434758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.436368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.446803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1239/2442] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:26:18.451191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.461419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95e20-7415-4a52-9c2d-b9c76defac8c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.466197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.467353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.467353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.467614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] PATH_INFO: `/v3/projects/c2170856e1244dba816486436f7f99e2/users/99718e041c9d426c925ef2b2cffe2c05/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.482994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2170856e1244dba816486436f7f99e2, user_id=99718e041c9d426c925ef2b2cffe2c05, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.485696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.503508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1204/2443] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:26:18 2022] PUT /identity/v3/projects/c2170856e1244dba816486436f7f99e2/users/99718e041c9d426c925ef2b2cffe2c05/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:18.507482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.517721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df932088-3a35-4a12-b062-0821c1960911 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.536776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.538563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.584677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.585480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.585821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.586167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.586976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.588676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.599898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1240/2444] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:26:18.604106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:26:18.614809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66266-aabc-490e-912f-2b30b7c7acb4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.619662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194906-8de1-40e3-a8f7-51f439685d16 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:26:18.619862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9825be-7165-40d5-a4a5-2d1ba14054f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.621419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9825be-7165-40d5-a4a5-2d1ba14054f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.621696 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9825be-7165-40d5-a4a5-2d1ba14054f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.622023 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9825be-7165-40d5-a4a5-2d1ba14054f0 admin admin] PATH_INFO: `/v3/projects/c2170856e1244dba816486436f7f99e2/users/99718e041c9d426c925ef2b2cffe2c05/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.624040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9825be-7165-40d5-a4a5-2d1ba14054f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2170856e1244dba816486436f7f99e2, user_id=99718e041c9d426c925ef2b2cffe2c05, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.626802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9825be-7165-40d5-a4a5-2d1ba14054f0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.627622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:26:18.628501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.628944 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.629368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.631452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.638168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1241/2445] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:26:18 2022] PUT /identity/v3/projects/c2170856e1244dba816486436f7f99e2/users/99718e041c9d426c925ef2b2cffe2c05/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:26:18.645506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:26:18.647183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:26:18.649464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:26:18.649875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:26:18.650219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:26:18.658667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1205/2446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:26:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:26:18.681392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] MFA Rules not processed for user `99718e041c9d426c925ef2b2cffe2c05`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:26:18.683776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:26:18.753229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1242/2447] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:26:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:28:03.140193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.141618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:03.195809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71ac21-9d38-4c7d-8de7-dffee49d000a service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.240992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.241632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.241945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.242215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.243960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:03.308307 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.309770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.320181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1206/2448] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:28:03.347914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.353179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.354581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:03.355086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918203d-5785-44f2-ad46-53b459caecf7 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.358574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.359206 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.359580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.359758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.361501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:03.368161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04443f2c-72cf-49f5-99b8-8ff87a2bdb6e service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.373916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.374559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.375541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.375541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.377061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:03.441620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.443141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.443742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.445377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.461724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1243/2449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:28:03.464242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1207/2450] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:28:03.509838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.518802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59926b-f6e2-43bd-b0ba-0df8303c1c90 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.522801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.523444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.523725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.523997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.533722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.535279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.545803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1244/2451] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:28:03.815873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:28:03.826295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112759e-0591-4398-817e-6a9f8cbc2a08 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:28:03.829899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:28:03.830573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:28:03.830850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:28:03.831243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:28:03.833058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:28:03.846431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:28:03.847875 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:28:03.859491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1208/2452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:30:03.991998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.010160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f57f5-334b-411e-8145-3904d488b39a service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:04.013709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:04.014368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:04.014644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:04.014916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:04.016689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:30:04.095600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:04.097034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:04.105870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1245/2453] 10.222.0.70 () {60 vars in 1396 bytes} [Mon May 16 17:30:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:30:04.131205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:30:04.148411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb29e-c6df-42b8-8767-b59ed41196d4 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:30:04.152548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:30:04.153182 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:30:04.153455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:30:04.153724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:30:04.208146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:30:04.210064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:30:04.220081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1209/2454] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:30:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:10.917331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:10.918715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:11.009094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1157734-c0b4-4dce-89c4-95ddf4fcd464 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:11.014132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:11.014772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:11.015052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:11.015324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:11.017082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:11.028813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:11.030442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:11.040637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1246/2455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:40.283084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:40.284575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:40.295452 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81352005-5fd6-4d2e-a74a-726d47694a15 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:40.299579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:40.300294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:40.300535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:40.300785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:40.303009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:40.388814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:40.390315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175f96b-a0bd-46f9-b97c-5c53d9688eaa service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:40.412574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1210/2456] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:40.655691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:40.723408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d37223-2403-4fcb-8cf8-00794da5aedd service placement] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:40.728692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:40.729593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:40.729904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:40.730297 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] PATH_INFO: `/v3/users/bed6cf8a538545709187e92ea0d33846` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:40.731606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed6cf8a538545709187e92ea0d33846)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:40.733612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:40.777996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed6cf8a538545709187e92ea0d33846'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:40.784413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed6cf8a538545709187e92ea0d33846'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:40.791603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed6cf8a538545709187e92ea0d33846'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:40.803750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed6cf8a538545709187e92ea0d33846'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:40.804433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed6cf8a538545709187e92ea0d33846'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:40.811020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1247/2457] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:40 2022] DELETE /identity/v3/users/bed6cf8a538545709187e92ea0d33846 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:40.815746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:40.816036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:40.816315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:40.837501 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:40.839057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:40.916104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:40.917923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:40.937840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1211/2458] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:40.945067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:40.947223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:40.989916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64bce5-373e-4955-b529-275f385e0bc6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:40.995131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:40.996182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:40.996464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:40.996739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] PATH_INFO: `/v3/users/bd8cf7b9f208496f9fc4b74199a82c59` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:40.998133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8cf7b9f208496f9fc4b74199a82c59)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.000337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.006389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb393b-9047-44ed-b868-c9ed4d2e2974 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.011471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ecbd5-9b04-4254-a117-f109a3fd7509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.012225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ecbd5-9b04-4254-a117-f109a3fd7509 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.012615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ecbd5-9b04-4254-a117-f109a3fd7509 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.012965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ecbd5-9b04-4254-a117-f109a3fd7509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.023243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ecbd5-9b04-4254-a117-f109a3fd7509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.025489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ecbd5-9b04-4254-a117-f109a3fd7509 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.036544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1212/2459] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:41.056926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8cf7b9f208496f9fc4b74199a82c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.066690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8cf7b9f208496f9fc4b74199a82c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.076975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8cf7b9f208496f9fc4b74199a82c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.091787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8cf7b9f208496f9fc4b74199a82c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.092667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8cf7b9f208496f9fc4b74199a82c59'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.098693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1248/2460] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:40 2022] DELETE /identity/v3/users/bd8cf7b9f208496f9fc4b74199a82c59 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:41.103090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.103377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.103708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.123319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:41.124549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.188650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1213/2461] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:41.207803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.209286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.266618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278af0a-8430-4afd-b114-3d51b0c92129 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.270415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.271066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.271342 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.271613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.281313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.282786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.292836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1249/2462] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:41.317618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.319619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.333765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef341963-5183-4c40-b459-bcb5579ec2f5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.341905 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.343543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.359625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.360648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] PATH_INFO: `/v3/projects/efacce8fbba14ac081a71578d95eadf5` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.362692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efacce8fbba14ac081a71578d95eadf5)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.364895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.417401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efacce8fbba14ac081a71578d95eadf5', 'request_id': 'req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.425259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efacce8fbba14ac081a71578d95eadf5', 'request_id': 'req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.431359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efacce8fbba14ac081a71578d95eadf5', 'request_id': 'req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.442598 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] The token cache is being invalidate because project efacce8fbba14ac081a71578d95eadf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:41.443008 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.443803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.449315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1214/2463] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:41 2022] DELETE /identity/v3/projects/efacce8fbba14ac081a71578d95eadf5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:41.451939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.463335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944599a7-dee2-47b3-aa38-fda05c7fa588 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.518079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.518949 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.519228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.519502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] PATH_INFO: `/v3/users/99718e041c9d426c925ef2b2cffe2c05` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.520920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99718e041c9d426c925ef2b2cffe2c05)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.522903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.568564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99718e041c9d426c925ef2b2cffe2c05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.576503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.577986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.587454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99718e041c9d426c925ef2b2cffe2c05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.596066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99718e041c9d426c925ef2b2cffe2c05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.606859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b9e13-d5ad-4ebb-8b4f-73a7002531c0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.609984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99718e041c9d426c925ef2b2cffe2c05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.610670 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-8958fd51-c9ed-4aed-b0f3-80b945909104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99718e041c9d426c925ef2b2cffe2c05'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.611698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.612548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.612824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.613095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] PATH_INFO: `/v3/projects/96bd5598466d47718e0a2522d2211d2b` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.614284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bd5598466d47718e0a2522d2211d2b)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.616205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.616609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1250/2464] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:41 2022] DELETE /identity/v3/users/99718e041c9d426c925ef2b2cffe2c05 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:41.681332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bd5598466d47718e0a2522d2211d2b', 'request_id': 'req-21daa02b-efe4-4763-80c3-eda83f3872a8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.690797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bd5598466d47718e0a2522d2211d2b', 'request_id': 'req-21daa02b-efe4-4763-80c3-eda83f3872a8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.698484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bd5598466d47718e0a2522d2211d2b', 'request_id': 'req-21daa02b-efe4-4763-80c3-eda83f3872a8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.710096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] The token cache is being invalidate because project 96bd5598466d47718e0a2522d2211d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:41.710387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.711084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-21daa02b-efe4-4763-80c3-eda83f3872a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:41.712992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1215/2465] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:41 2022] DELETE /identity/v3/projects/96bd5598466d47718e0a2522d2211d2b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:41.717673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.718224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.718224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.741649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:41.743613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.816379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1251/2466] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:41.825775 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.826090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.826439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.845040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:41.846279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.855149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1216/2467] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:41.859328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.868997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342021-522a-4272-890b-b6dccc8d4f62 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.873831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.874517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.874794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.875067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.875817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:41.876127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.877803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.889230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1252/2468] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:31:41.893589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.903086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241841b8-2c66-431f-836d-c7e91374c917 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:41.908013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:41.908663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:41.909303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:41.909303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:41.910162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:41.912534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:41.924497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.927761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:41.945805 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1217/2469] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:41 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:41.948704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:41.951659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56234c-bbc9-424a-abb6-614038e9cc5b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.010814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23536fd-d539-48cf-909d-0bf3d69e2a02 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.011219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.012071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.012344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.012614 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] PATH_INFO: `/v3/projects/c2170856e1244dba816486436f7f99e2` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.013824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2170856e1244dba816486436f7f99e2)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.015541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.015739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.016197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.016474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.016745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.017418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.019382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.039871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1218/2470] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:41 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:42.044337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.054323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef98074-d9fb-439c-a222-2e87d8e88475 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.060545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2170856e1244dba816486436f7f99e2', 'request_id': 'req-92fd4409-301e-4fa2-b1ed-42d893711e4b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:42.068032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2170856e1244dba816486436f7f99e2', 'request_id': 'req-92fd4409-301e-4fa2-b1ed-42d893711e4b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:42.074388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2170856e1244dba816486436f7f99e2', 'request_id': 'req-92fd4409-301e-4fa2-b1ed-42d893711e4b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:42.087095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] The token cache is being invalidate because project c2170856e1244dba816486436f7f99e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:42.087383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:42.088217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-92fd4409-301e-4fa2-b1ed-42d893711e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:42.090604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1253/2471] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:41 2022] DELETE /identity/v3/projects/c2170856e1244dba816486436f7f99e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:42.097242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.097599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.097975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.114824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2912-f238-4d38-a5f6-d87daddc3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.115490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2912-f238-4d38-a5f6-d87daddc3c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.115767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2912-f238-4d38-a5f6-d87daddc3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.115899 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:42.116062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2912-f238-4d38-a5f6-d87daddc3c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.116780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2912-f238-4d38-a5f6-d87daddc3c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.117076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.118957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2912-f238-4d38-a5f6-d87daddc3c25 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.126120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1254/2472] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:42.128658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1219/2473] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:42.132381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.133315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.134383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.134797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.135092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.145719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2012b-fe52-40f4-8077-219669c8f476 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.150341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.150993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.151266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.151536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.152253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.152593 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:42.153839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.153961 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.161863 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1220/2474] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:42.165172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1255/2475] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:42.166585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.169184 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.175624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d927f89-03a4-42d3-ad55-f24611dc6164 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.178694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9de587-3907-4668-bf41-49f0f40fdf52 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.181163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.181843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.182122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.182389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.183115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:42.183421 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.183978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8ddf5-1ebc-4f9d-b765-22d4433a5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.184831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ddf5-1ebc-4f9d-b765-22d4433a5adb admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.185020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.185148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ddf5-1ebc-4f9d-b765-22d4433a5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.185363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ddf5-1ebc-4f9d-b765-22d4433a5adb admin admin] PATH_INFO: `/v3/projects/c19c6bd81dc445dfa6fea9c176c723d7/users/2fa054e6b8c64e76b5e06c70333e28b1/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.196982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1221/2476] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:31:42.200913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8ddf5-1ebc-4f9d-b765-22d4433a5adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19c6bd81dc445dfa6fea9c176c723d7, user_id=2fa054e6b8c64e76b5e06c70333e28b1, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.201393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.203658 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8ddf5-1ebc-4f9d-b765-22d4433a5adb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.212645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd6a3b-c22c-4495-acaf-4d255691d2ca admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.217834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1256/2477] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:42 2022] PUT /identity/v3/projects/c19c6bd81dc445dfa6fea9c176c723d7/users/2fa054e6b8c64e76b5e06c70333e28b1/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:42.227815 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.228102 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.228376 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.253410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] MFA Rules not processed for user `2fa054e6b8c64e76b5e06c70333e28b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:42.254640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.268003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.268661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.268942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.269214 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.269927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.271847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.298538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1222/2478] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:42.302735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.317555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1257/2479] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:42.323030 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.333094 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdd41b-cefc-413d-b6d8-45b3dc0398d6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.363139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861aee4-60b8-48b0-84e5-a4e6c75d1221 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.368298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.368966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.369256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.369521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.370254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.372205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.388459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.389199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.389545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.389911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.390655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.392366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1223/2480] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:42.392632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.396403 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.409145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfad8d2-2fd3-4f05-8a8e-94152598acfb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.412413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.413231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.413780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.414204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.415223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.416816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.423413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1258/2481] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:42.424440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.429877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1224/2482] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:42.430733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.440081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68408c-1d9a-416c-8d08-0839a4cf3c09 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.484437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be367-a0d9-45df-97e9-76bea601d762 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.489046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.489701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.490008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.490280 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.490955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.493452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.497076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.497757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.498039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.498315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.499030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.500622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.512009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1225/2483] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:42.516834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1259/2484] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:42.517083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.517806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.526111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206be8b-8a93-4abd-bafb-81bbd6a1a4ce admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.527791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bbebe-f8e1-4bf5-a657-77c22f5f54c0 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.530701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297546d-a180-41dc-8b25-c0126e72a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.531581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297546d-a180-41dc-8b25-c0126e72a638 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.531854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297546d-a180-41dc-8b25-c0126e72a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.532153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297546d-a180-41dc-8b25-c0126e72a638 admin admin] PATH_INFO: `/v3/projects/b8426402dfe343b4936a6ee1f79e1d71/users/48367ae9d441471abe653f3e0cd786d7/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.532673 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.533313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.533589 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.533904 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.534630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.536227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.546639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1260/2485] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:42.546891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297546d-a180-41dc-8b25-c0126e72a638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8426402dfe343b4936a6ee1f79e1d71, user_id=48367ae9d441471abe653f3e0cd786d7, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.549565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297546d-a180-41dc-8b25-c0126e72a638 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.550661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.560397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca5bd-25fd-4da7-abc2-f3f8e7ca7e92 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.563385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1226/2486] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:42 2022] PUT /identity/v3/projects/b8426402dfe343b4936a6ee1f79e1d71/users/48367ae9d441471abe653f3e0cd786d7/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:42.575015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.575543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.575818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.602813 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] MFA Rules not processed for user `48367ae9d441471abe653f3e0cd786d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:42.604038 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.616393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.617212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.617494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.617793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] PATH_INFO: `/v3/projects/09e92af6621d4dcba157de6da10dafdd/users/2fe6b1011cfc4e219b627769d55cd5cf/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.631513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e92af6621d4dcba157de6da10dafdd, user_id=2fe6b1011cfc4e219b627769d55cd5cf, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.634506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.658110 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1261/2487] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:42 2022] PUT /identity/v3/projects/09e92af6621d4dcba157de6da10dafdd/users/2fe6b1011cfc4e219b627769d55cd5cf/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:42.663245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.674600 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1227/2488] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:42.679060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.689190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225710-cfc3-414c-8237-7fff70e22449 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.723519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d071-fcb8-4f9f-a0b1-2d2f63dda1c9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.728737 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.729393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.729675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.729974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.730700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.732319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.741886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1262/2489] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:42.742912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.743567 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.743845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.744116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.745056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.745817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.747041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.755048 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30a9fd-e66c-4186-9e77-c90881c35e6d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.759611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae1e41-1edd-48f6-a895-dc89c31599b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.760465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae1e41-1edd-48f6-a895-dc89c31599b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.760746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae1e41-1edd-48f6-a895-dc89c31599b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.761017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae1e41-1edd-48f6-a895-dc89c31599b4 admin admin] PATH_INFO: `/v3/projects/09e92af6621d4dcba157de6da10dafdd/users/2fe6b1011cfc4e219b627769d55cd5cf/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.763642 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae1e41-1edd-48f6-a895-dc89c31599b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e92af6621d4dcba157de6da10dafdd, user_id=2fe6b1011cfc4e219b627769d55cd5cf, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.766505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae1e41-1edd-48f6-a895-dc89c31599b4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.776890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1228/2490] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:42.777778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.779046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1263/2491] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:42 2022] PUT /identity/v3/projects/09e92af6621d4dcba157de6da10dafdd/users/2fe6b1011cfc4e219b627769d55cd5cf/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:42.789152 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.789477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.790338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.821553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] MFA Rules not processed for user `2fe6b1011cfc4e219b627769d55cd5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:42.821903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.850788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe0879-3c31-473f-b897-230ad56944f6 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.856110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.856883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.857164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.857430 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.858147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.860092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.884972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1229/2492] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:42.885770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.894892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1264/2493] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:42.895471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868143-c368-44c1-93c7-4443eb0feac4 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.900358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.901090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.901375 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.901647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.902436 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.904050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.905429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.906811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:42.914269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1230/2494] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:42.918784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:42.928269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffed10-dab5-4280-b543-5e0fcd54ad19 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.933508 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:42.934382 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:42.934655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:42.934923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] PATH_INFO: `/v3/projects/c3f8855d57904af2ab25f3dd4799b231/users/37def67fbbd34d70bb01d659328f4c79/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:42.954509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8855d57904af2ab25f3dd4799b231, user_id=37def67fbbd34d70bb01d659328f4c79, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:42.957232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:42.971191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bc22-5c86-4194-94cf-19c98193b3e7 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:42.971889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1231/2495] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:42 2022] PUT /identity/v3/projects/c3f8855d57904af2ab25f3dd4799b231/users/37def67fbbd34d70bb01d659328f4c79/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:42.979314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.022133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533064d0-bb60-4b93-942a-03b72d7b0def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.023214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533064d0-bb60-4b93-942a-03b72d7b0def service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.023680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533064d0-bb60-4b93-942a-03b72d7b0def service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.024142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533064d0-bb60-4b93-942a-03b72d7b0def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.054674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115376e-5f31-4eea-ba02-3a5e0121e362 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:43.060210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.060868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.061146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.061409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.062163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.063782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.073927 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1232/2496] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:43.078006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.087266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ea165-9b03-4a22-ba1e-b0f3e95f5887 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:43.089606 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533064d0-bb60-4b93-942a-03b72d7b0def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.091103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533064d0-bb60-4b93-942a-03b72d7b0def service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.091810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.092686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.092956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.093219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] PATH_INFO: `/v3/projects/c3f8855d57904af2ab25f3dd4799b231/users/37def67fbbd34d70bb01d659328f4c79/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.095179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8855d57904af2ab25f3dd4799b231, user_id=37def67fbbd34d70bb01d659328f4c79, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.097827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.100750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1265/2497] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:43.108048 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1233/2498] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:43 2022] PUT /identity/v3/projects/c3f8855d57904af2ab25f3dd4799b231/users/37def67fbbd34d70bb01d659328f4c79/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:43.118538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.118817 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.119028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.146560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] MFA Rules not processed for user `37def67fbbd34d70bb01d659328f4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:43.147643 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:43.216552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1266/2499] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:43.228036 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.229726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:43.286175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19411-e817-494d-ab89-3d8365932761 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:43.290369 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f23371-3ed0-4f2d-a071-aebb9bb5bc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.291005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23371-3ed0-4f2d-a071-aebb9bb5bc12 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.291277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23371-3ed0-4f2d-a071-aebb9bb5bc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.291544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f23371-3ed0-4f2d-a071-aebb9bb5bc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.300392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f23371-3ed0-4f2d-a071-aebb9bb5bc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.301887 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f23371-3ed0-4f2d-a071-aebb9bb5bc12 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.311103 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1234/2500] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:43.374259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.433861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a02f-1cd4-48d8-b020-75eb264d22ff None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:43.438299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.439766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.439766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.439766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] PATH_INFO: `/v3/users/48367ae9d441471abe653f3e0cd786d7` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.440963 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48367ae9d441471abe653f3e0cd786d7)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.442947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.486162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48367ae9d441471abe653f3e0cd786d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:43.493079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48367ae9d441471abe653f3e0cd786d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:43.500093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48367ae9d441471abe653f3e0cd786d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:43.511894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48367ae9d441471abe653f3e0cd786d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:43.512563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48367ae9d441471abe653f3e0cd786d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:43.518311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1267/2501] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:43 2022] DELETE /identity/v3/users/48367ae9d441471abe653f3e0cd786d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:43.522837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.523333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.523454 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.540335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:43.541512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:43.597226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1235/2502] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:43.606998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.608377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:43.663037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c9541-89ad-4150-a78d-c4ad30756a66 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:43.667150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.667784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.668067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.668339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.677193 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.678654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.688395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1268/2503] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:43.928035 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.931634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:43.948901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2482a-bdb7-4260-b8f9-8161a720825a None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:43.957523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:43.958812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:43.959295 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:43.959556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] PATH_INFO: `/v3/users/2fa054e6b8c64e76b5e06c70333e28b1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:43.961163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa054e6b8c64e76b5e06c70333e28b1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:43.963319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:43.976237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:43.978242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.026687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad8e0b-af90-4e0a-814d-943a2f94f0b2 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.041030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa054e6b8c64e76b5e06c70333e28b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.042516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:44.048571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.048913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.049245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] PATH_INFO: `/v3/projects/b8426402dfe343b4936a6ee1f79e1d71` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.054410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8426402dfe343b4936a6ee1f79e1d71)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:44.068010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:44.072579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa054e6b8c64e76b5e06c70333e28b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.087860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa054e6b8c64e76b5e06c70333e28b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.090133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa054e6b8c64e76b5e06c70333e28b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.110535 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-da32f1c0-c6ce-47c3-9546-e8791a72b715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa054e6b8c64e76b5e06c70333e28b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.117572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1236/2504] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:43 2022] DELETE /identity/v3/users/2fa054e6b8c64e76b5e06c70333e28b1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:44.122880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.123192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.123482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.127879 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8426402dfe343b4936a6ee1f79e1d71', 'request_id': 'req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.137633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8426402dfe343b4936a6ee1f79e1d71', 'request_id': 'req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.143699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:44.145039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.146271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8426402dfe343b4936a6ee1f79e1d71', 'request_id': 'req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.167143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] The token cache is being invalidate because project b8426402dfe343b4936a6ee1f79e1d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:44.167428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.168082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.172990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1269/2505] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:43 2022] DELETE /identity/v3/projects/b8426402dfe343b4936a6ee1f79e1d71 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:44.173808 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:44.175752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.216971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1237/2506] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:44.230092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:44.233013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.244794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b93f7-03f5-476b-b3f4-5f6dec902a9d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.249564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:44.250475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.250760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.251031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] PATH_INFO: `/v3/users/37def67fbbd34d70bb01d659328f4c79` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.252256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=37def67fbbd34d70bb01d659328f4c79)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:44.254656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:44.295518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921de51d-2dad-4679-aa10-8fe92d7a94da None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.299800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:44.300686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.301215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.301726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.302662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37def67fbbd34d70bb01d659328f4c79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.309889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37def67fbbd34d70bb01d659328f4c79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.312003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:44.313450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:44.318095 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37def67fbbd34d70bb01d659328f4c79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.324171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1238/2507] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:44.335159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37def67fbbd34d70bb01d659328f4c79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.337794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37def67fbbd34d70bb01d659328f4c79'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.343743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1270/2508] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:44 2022] DELETE /identity/v3/users/37def67fbbd34d70bb01d659328f4c79 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:44.639943 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:44.650475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929480-e049-417d-800f-5658b51b79fb service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.685876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:44.687462 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.718240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:44.719115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.719439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.719663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] PATH_INFO: `/v3/projects/c3f8855d57904af2ab25f3dd4799b231` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.721041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f8855d57904af2ab25f3dd4799b231)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:44.723044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:44.790695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f8855d57904af2ab25f3dd4799b231', 'request_id': 'req-091b1569-398d-44b0-9328-0d66904f3482'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.797542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1962d-7815-4796-a891-e1f1febd58fe admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.801550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f8855d57904af2ab25f3dd4799b231', 'request_id': 'req-091b1569-398d-44b0-9328-0d66904f3482'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.814930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f8855d57904af2ab25f3dd4799b231', 'request_id': 'req-091b1569-398d-44b0-9328-0d66904f3482'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.826933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] The token cache is being invalidate because project c3f8855d57904af2ab25f3dd4799b231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:44.827230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.828021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:44.829708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1239/2509] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:44 2022] DELETE /identity/v3/projects/c3f8855d57904af2ab25f3dd4799b231 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:44.833305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:44.833305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.868098 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:44.868754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.869038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.869313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.871230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.888431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:44.890113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac222df-efd8-43a4-b150-cdc9d978c258 service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:44.902505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1271/2510] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:44.904071 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb7bf-3cff-4991-8678-5bf25f1194a6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.904366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb7bf-3cff-4991-8678-5bf25f1194a6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.904702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfb7bf-3cff-4991-8678-5bf25f1194a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.928432 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-ebbfb7bf-3cff-4991-8678-5bf25f1194a6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:44.929648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ebbfb7bf-3cff-4991-8678-5bf25f1194a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.938634 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1272/2511] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:44.939829 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1569-398d-44b0-9328-0d66904f3482 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.946311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:44.947131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.947499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:44.947659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.947886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:44.948007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] PATH_INFO: `/v3/projects/c19c6bd81dc445dfa6fea9c176c723d7` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.948107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:44.949098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19c6bd81dc445dfa6fea9c176c723d7)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:44.951062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:44.966224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:44.967403 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:44.975298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1273/2512] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:44.980168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:44.989116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773408d-3c0c-4379-8a91-3a419cf65f55 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:44.999707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19c6bd81dc445dfa6fea9c176c723d7', 'request_id': 'req-a0f8d306-fa75-4a8b-93ed-1bbc47845159'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.006938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19c6bd81dc445dfa6fea9c176c723d7', 'request_id': 'req-a0f8d306-fa75-4a8b-93ed-1bbc47845159'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.014002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19c6bd81dc445dfa6fea9c176c723d7', 'request_id': 'req-a0f8d306-fa75-4a8b-93ed-1bbc47845159'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.025235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] The token cache is being invalidate because project c19c6bd81dc445dfa6fea9c176c723d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:45.025364 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.026061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.027647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1240/2513] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:44 2022] DELETE /identity/v3/projects/c19c6bd81dc445dfa6fea9c176c723d7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:45.031439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.032735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.047364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.048033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.048313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.048585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.049301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:45.049605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.051292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.063938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1274/2514] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:31:45.067981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.069671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.083312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7b587-e23a-4673-9959-683fc7763943 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.089254 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.089948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.090232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.090504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.091187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.093115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.099131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d306-fa75-4a8b-93ed-1bbc47845159 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.104566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.105433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.105708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.105999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] PATH_INFO: `/v3/users/2fe6b1011cfc4e219b627769d55cd5cf` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.107189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe6b1011cfc4e219b627769d55cd5cf)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.109149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.130704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1275/2515] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:45.134991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.165772 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe6b1011cfc4e219b627769d55cd5cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.174538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe6b1011cfc4e219b627769d55cd5cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.185837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe6b1011cfc4e219b627769d55cd5cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.187162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe6b1011cfc4e219b627769d55cd5cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.204310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe6b1011cfc4e219b627769d55cd5cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.207747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd40687-f409-4146-86d9-6d25c46230b3 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.212482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1241/2516] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:45 2022] DELETE /identity/v3/users/2fe6b1011cfc4e219b627769d55cd5cf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:45.214071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.215331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.215671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.216685 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.217126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.217485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.218257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.220331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.269798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1276/2517] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:45.272837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.276437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.298424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5de1d-00d2-4987-931d-7363139712c2 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.304219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde47c-d1bc-4fe5-965b-84cd1ad5dd77 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.311968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.313086 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.313457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.313763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.315930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.388139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.389127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.389570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.390045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.390995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.392914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.403128 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.409609 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1277/2518] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:45.410563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.424377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.425284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08802c4-3578-4666-ad95-1a872f51a1fe admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.430172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc2be7-d7ba-4aaa-99a1-b367362c4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.430834 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2be7-d7ba-4aaa-99a1-b367362c4d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.431113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2be7-d7ba-4aaa-99a1-b367362c4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.431383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc2be7-d7ba-4aaa-99a1-b367362c4d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.434370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2be7-d7ba-4aaa-99a1-b367362c4d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.436011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc2be7-d7ba-4aaa-99a1-b367362c4d86 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.439983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1242/2519] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:45.449435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1278/2520] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:45.453666 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.466222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4227-7881-4089-8a69-0eb6d7ddf7b7 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.472789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.474108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.474586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.475396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] PATH_INFO: `/v3/projects/72e22c7704e84577a66db483ee18a3ea/users/d11de800a40d448b96fcd427a50757ba/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.494355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e22c7704e84577a66db483ee18a3ea, user_id=d11de800a40d448b96fcd427a50757ba, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.497372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.518900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1243/2521] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:45 2022] PUT /identity/v3/projects/72e22c7704e84577a66db483ee18a3ea/users/d11de800a40d448b96fcd427a50757ba/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:45.530250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.530579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.530822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.566739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] MFA Rules not processed for user `d11de800a40d448b96fcd427a50757ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:45.568010 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.651551 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1279/2522] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:45.660243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.689494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.691798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.744099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506e763-a5ab-4f38-8c78-9871ed4feddb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.749419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.750195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.750475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.750750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.751443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.753376 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.763270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f3317-3ac7-4eda-86a2-68449f5b0a97 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.768287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.770194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.770488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.770896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] PATH_INFO: `/v3/projects/09e92af6621d4dcba157de6da10dafdd` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.772175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e92af6621d4dcba157de6da10dafdd)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.774918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.783561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1244/2523] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:45.787169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.828388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e92af6621d4dcba157de6da10dafdd', 'request_id': 'req-bef967c7-f7f0-43c8-a338-c56f18a6514b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.838806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e92af6621d4dcba157de6da10dafdd', 'request_id': 'req-bef967c7-f7f0-43c8-a338-c56f18a6514b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.844641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e92af6621d4dcba157de6da10dafdd', 'request_id': 'req-bef967c7-f7f0-43c8-a338-c56f18a6514b'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.856012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f76bf-846d-4910-9d0a-4d872b788528 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.857121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] The token cache is being invalidate because project 09e92af6621d4dcba157de6da10dafdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:45.857121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.858147 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bef967c7-f7f0-43c8-a338-c56f18a6514b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:45.859827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1280/2524] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:45 2022] DELETE /identity/v3/projects/09e92af6621d4dcba157de6da10dafdd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:45.864437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50201a2-44af-418f-af09-e955dd814ae7 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.864853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50201a2-44af-418f-af09-e955dd814ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.865620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50201a2-44af-418f-af09-e955dd814ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.896002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e50201a2-44af-418f-af09-e955dd814ae7 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:45.897457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e50201a2-44af-418f-af09-e955dd814ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.922081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.922916 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.923197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.923471 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.924166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.926210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.951575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1245/2525] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:45.954372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:45.956068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:45.964301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1281/2526] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:45.973688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.973997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.974267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.975590 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1211ae3-b45c-4fc8-8983-abb7ba1cbb55 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:45.987171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:45.987991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:45.988368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:45.988737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:45.989595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:45.991329 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:45.994640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:45.995831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:46.005074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1246/2527] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:46.005266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1282/2528] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:46.006894 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.008757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.018022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75274e8-0d1b-48b0-8888-8571992209ba None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.019004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836ef0-4dd5-4f2f-b939-a3ca8cd833be admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.022738 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.023535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.024359 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.024767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.025537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:46.025681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.025868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.026921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.027359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.027490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.027909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] PATH_INFO: `/v3/projects/62d35582391e4f93b4ffac820fc1044d/users/51d46f75c63243488db4291785449a82/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.040240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1283/2529] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:31:46.044395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.044832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d35582391e4f93b4ffac820fc1044d, user_id=51d46f75c63243488db4291785449a82, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.048093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.055032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c42ff6-af9e-40d0-ac41-c42a77e01308 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.065817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1247/2530] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:46 2022] PUT /identity/v3/projects/62d35582391e4f93b4ffac820fc1044d/users/51d46f75c63243488db4291785449a82/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:46.068408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.119784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.120545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.120934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.121583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.122137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.124176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.131959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11335e-062a-4482-b0cd-a22a578fa9b1 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.143380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.144244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.144661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.144845 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.145763 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.147411 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.156466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1284/2531] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:46 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:46.157434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.161792 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1248/2532] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:46.163942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.174568 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5fec7-e42c-46f6-a96b-7b40235e0996 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.221778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941955b9-81bf-4fb2-9628-3e875c3248b5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.226650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.227452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.227880 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.228210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.228994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.231650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.233371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb0749-f4c0-447e-9351-57f670da8a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.234325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb0749-f4c0-447e-9351-57f670da8a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.234881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb0749-f4c0-447e-9351-57f670da8a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.234881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb0749-f4c0-447e-9351-57f670da8a23 admin admin] PATH_INFO: `/v3/projects/62d35582391e4f93b4ffac820fc1044d/users/51d46f75c63243488db4291785449a82/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.236841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb0749-f4c0-447e-9351-57f670da8a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d35582391e4f93b4ffac820fc1044d, user_id=51d46f75c63243488db4291785449a82, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.239546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb0749-f4c0-447e-9351-57f670da8a23 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.251815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1249/2533] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:46 2022] PUT /identity/v3/projects/62d35582391e4f93b4ffac820fc1044d/users/51d46f75c63243488db4291785449a82/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:46.254368 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1285/2534] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:46 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:46.262400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.262580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.262883 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.263027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.272285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b772bf-9680-4156-a1c6-cda8369a0b8c admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.290033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] MFA Rules not processed for user `51d46f75c63243488db4291785449a82`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:46.291513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:46.329708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.330408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.330682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.330951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.331892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.333659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.344063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1286/2535] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:46.347902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.358937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e11b2-2781-432c-a3b1-985a61541307 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.365798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.366286 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1250/2536] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:46.366649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.366996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.367271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.368027 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.369648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.379270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.380946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:46.384829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1287/2537] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:46.390041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.400331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23812cce-dfd0-4490-8004-0c4f04c09061 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.407481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec29fa-4b28-4ce0-bd06-3fb26ef5b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.408382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec29fa-4b28-4ce0-bd06-3fb26ef5b428 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.408659 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec29fa-4b28-4ce0-bd06-3fb26ef5b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.412612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec29fa-4b28-4ce0-bd06-3fb26ef5b428 admin admin] PATH_INFO: `/v3/projects/54b2f9ea19a34a40adee92b3ba1ff1c3/users/048e7c4575d44d548b50254561c9a7dd/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.432400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec29fa-4b28-4ce0-bd06-3fb26ef5b428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b2f9ea19a34a40adee92b3ba1ff1c3, user_id=048e7c4575d44d548b50254561c9a7dd, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.435444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec29fa-4b28-4ce0-bd06-3fb26ef5b428 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.453814 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1288/2538] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:46 2022] PUT /identity/v3/projects/54b2f9ea19a34a40adee92b3ba1ff1c3/users/048e7c4575d44d548b50254561c9a7dd/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:46.461610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d37794-1530-4c6a-93d7-1737cec6e669 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.462175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.462588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.463089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.491222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] MFA Rules not processed for user `048e7c4575d44d548b50254561c9a7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:46.496319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:46.529587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.530298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.530577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.530849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.569810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1289/2539] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:46.574523 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.644267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.645934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.658474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1251/2540] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:46.682058 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd05e41-4eef-4136-8713-46ad690267df None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.688393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.689075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.689348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.689621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.690362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.692343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.744624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1290/2541] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:46 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:46.748630 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.765114 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd93ad-7cd9-409c-9ff4-cb503c88d7ff service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.856393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.857328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.857680 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.858044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.859013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.861020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.884224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1252/2542] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:46 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:46.888713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.899364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0d1d7-0193-4413-a622-8319d7319a25 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.905430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.906431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.906975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.907252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.907993 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.909623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.921288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1291/2543] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:46.925431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.937018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615abac2-9dd2-449c-8921-c3c314451168 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:46.941843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:46.942732 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:46.943009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:46.943278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] PATH_INFO: `/v3/projects/c9d9ba076f4d449998e51b8af7679589/users/0f62bba2ca4f4caab6c6d2ad9afd0f83/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:46.959107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d9ba076f4d449998e51b8af7679589, user_id=0f62bba2ca4f4caab6c6d2ad9afd0f83, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:46.961879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:46.975859 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1253/2544] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:46 2022] PUT /identity/v3/projects/c9d9ba076f4d449998e51b8af7679589/users/0f62bba2ca4f4caab6c6d2ad9afd0f83/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:46.980597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:46.994405 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde463cb-46ab-4a69-9924-450fd30aaaf1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.063104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.064690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.064690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.064690 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.065205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.067118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.080357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1292/2545] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:47.084290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.094800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.096911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c89a4c-ffc6-48dd-a9d6-74dd1f51e10f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.107547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ae7cd-f452-4c80-ac55-7d9386f9230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.108559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae7cd-f452-4c80-ac55-7d9386f9230d admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.108993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae7cd-f452-4c80-ac55-7d9386f9230d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.110122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae7cd-f452-4c80-ac55-7d9386f9230d admin admin] PATH_INFO: `/v3/projects/c9d9ba076f4d449998e51b8af7679589/users/0f62bba2ca4f4caab6c6d2ad9afd0f83/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.112729 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae7cd-f452-4c80-ac55-7d9386f9230d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d9ba076f4d449998e51b8af7679589, user_id=0f62bba2ca4f4caab6c6d2ad9afd0f83, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.115822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae7cd-f452-4c80-ac55-7d9386f9230d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.128119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1254/2546] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:47 2022] PUT /identity/v3/projects/c9d9ba076f4d449998e51b8af7679589/users/0f62bba2ca4f4caab6c6d2ad9afd0f83/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:47.139272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.139626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.140122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.175016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] MFA Rules not processed for user `0f62bba2ca4f4caab6c6d2ad9afd0f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:47.176443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:47.192801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430b969-967d-4699-a25f-4eb5fca8775b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.257998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d46f75c63243488db4291785449a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62d35582391e4f93b4ffac820fc1044d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.258822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.259109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.259386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.260114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:47.260423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.262107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.266694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1255/2547] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:47.283074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1293/2548] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:31:47.285669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.291002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.297480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5e12-7c59-43e6-b6ae-e9d15be80a3d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.304612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d46f75c63243488db4291785449a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62d35582391e4f93b4ffac820fc1044d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.306788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.307242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.307715 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.308586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.310739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.344995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1256/2549] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:47 2022] POST /identity/v3/projects => generated 354 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:47.349353 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.363568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a6798-2ed2-44b8-ad9f-c4aea6fcb6b8 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.422905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.423569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.423850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.424127 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.443195 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6f283-80f2-4896-a2c2-42c24b1c4a47 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.449940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d46f75c63243488db4291785449a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62d35582391e4f93b4ffac820fc1044d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.450862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.451350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.451727 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.452607 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:47.453015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.454790 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.478041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1257/2550] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:31:47.502956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.504862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.515777 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1294/2551] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:47.532959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.548072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95e336-caa0-4e1e-9e09-475f5ca4de5e tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.554193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d46f75c63243488db4291785449a82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62d35582391e4f93b4ffac820fc1044d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.555911 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.556467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.557959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] PATH_INFO: `/v3/projects/66144f5d2ff944e0ac0266a1f3fbcc81` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.559547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorizing `identity:delete_project(project_id=66144f5d2ff944e0ac0266a1f3fbcc81)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.561925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.606482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.618411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf00e1-37f4-485f-9012-1902f8867ab9 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:47.628519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ef450-3608-4acd-985d-b7ad83374dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:47.629552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ef450-3608-4acd-985d-b7ad83374dbd service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:47.630047 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ef450-3608-4acd-985d-b7ad83374dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:47.630513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ef450-3608-4acd-985d-b7ad83374dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:47.659950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66144f5d2ff944e0ac0266a1f3fbcc81', 'request_id': 'req-f33cf182-9b20-459f-97b7-45e29e316920'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:47.673193 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66144f5d2ff944e0ac0266a1f3fbcc81', 'request_id': 'req-f33cf182-9b20-459f-97b7-45e29e316920'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:47.679570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66144f5d2ff944e0ac0266a1f3fbcc81', 'request_id': 'req-f33cf182-9b20-459f-97b7-45e29e316920'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:47.691062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] The token cache is being invalidate because project 66144f5d2ff944e0ac0266a1f3fbcc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:47.691344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:47.692153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:47.693811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1258/2552] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:47 2022] DELETE /identity/v3/projects/66144f5d2ff944e0ac0266a1f3fbcc81 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:47.731851 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ef450-3608-4acd-985d-b7ad83374dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:47.733610 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ef450-3608-4acd-985d-b7ad83374dbd service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:47.746299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1295/2553] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:47.971217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:47.972725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.052959 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cf182-9b20-459f-97b7-45e29e316920 tempest-VolumeQuotaClassesTest-1319765876 tempest-VolumeQuotaClassesTest-1319765876-project-admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:48.058542 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:48.059830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.060116 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.060466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] PATH_INFO: `/v3/users/d11de800a40d448b96fcd427a50757ba` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.062096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11de800a40d448b96fcd427a50757ba)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:48.064141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:48.175609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11de800a40d448b96fcd427a50757ba'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.187091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11de800a40d448b96fcd427a50757ba'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.199022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11de800a40d448b96fcd427a50757ba'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.199597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11de800a40d448b96fcd427a50757ba'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.216506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11de800a40d448b96fcd427a50757ba'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.225549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1259/2554] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:47 2022] DELETE /identity/v3/users/d11de800a40d448b96fcd427a50757ba => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:48.227283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.227739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.227826 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.249433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:48.250779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.316126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1296/2555] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:48.326982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:48.328504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.409560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a791-88ab-4216-9dfe-a55c3c4bb9d3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:48.412275 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:48.413062 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.413437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.413835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.424453 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:48.426063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:48.437248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1260/2556] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:48.769540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:48.771017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.783950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff85563-c528-43f7-998c-50e6c8ddafe6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:48.789194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:48.790160 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.790433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.790706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] PATH_INFO: `/v3/projects/72e22c7704e84577a66db483ee18a3ea` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.792569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e22c7704e84577a66db483ee18a3ea)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:48.796060 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:48.851453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e22c7704e84577a66db483ee18a3ea', 'request_id': 'req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.863236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e22c7704e84577a66db483ee18a3ea', 'request_id': 'req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.875420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e22c7704e84577a66db483ee18a3ea', 'request_id': 'req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.890911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] The token cache is being invalidate because project 72e22c7704e84577a66db483ee18a3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:48.891519 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.892112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:48.896565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1297/2557] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:48 2022] DELETE /identity/v3/projects/72e22c7704e84577a66db483ee18a3ea => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:48.897710 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:48.908649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fddebe-bc27-4b80-a3b9-2d4b76bc4cdf service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:48.943878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:48.945380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:48.983919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:48.985177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:48.985548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:48.985914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] PATH_INFO: `/v3/users/51d46f75c63243488db4291785449a82` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:48.987300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d46f75c63243488db4291785449a82)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:48.989260 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.033463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5478f8-9cb5-44ff-ac7c-6c4daaf04248 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:49.039139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:49.039955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d46f75c63243488db4291785449a82'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.040584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.041135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.041418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] PATH_INFO: `/v3/users/58633f982d3840dd88f631bcee882f5f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.043451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58633f982d3840dd88f631bcee882f5f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:49.045983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.047340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d46f75c63243488db4291785449a82'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.065147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d46f75c63243488db4291785449a82'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.066174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d46f75c63243488db4291785449a82'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.080327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d46f75c63243488db4291785449a82'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.087495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1261/2558] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:48 2022] DELETE /identity/v3/users/51d46f75c63243488db4291785449a82 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:49.100793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58633f982d3840dd88f631bcee882f5f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.108326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58633f982d3840dd88f631bcee882f5f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.117294 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58633f982d3840dd88f631bcee882f5f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.134155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58633f982d3840dd88f631bcee882f5f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.134974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9cb05dcb-37cb-4657-9bca-7214c8830171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58633f982d3840dd88f631bcee882f5f'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.142831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1298/2559] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:48 2022] DELETE /identity/v3/users/58633f982d3840dd88f631bcee882f5f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:49.450288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:49.451811 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:49.546045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bba40-269f-49b4-bf01-0b582828882a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:49.606372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:49.607349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.607692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.608031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] PATH_INFO: `/v3/projects/08b1d6066aaf4e969b8c69cd72d1de4e` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.609324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b1d6066aaf4e969b8c69cd72d1de4e)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:49.611377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.662557 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b1d6066aaf4e969b8c69cd72d1de4e', 'request_id': 'req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.671656 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b1d6066aaf4e969b8c69cd72d1de4e', 'request_id': 'req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.678584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b1d6066aaf4e969b8c69cd72d1de4e', 'request_id': 'req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.690313 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] The token cache is being invalidate because project 08b1d6066aaf4e969b8c69cd72d1de4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:49.690603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.691256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.697049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1262/2560] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:49 2022] DELETE /identity/v3/projects/08b1d6066aaf4e969b8c69cd72d1de4e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:49.699709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9477ee6-3aeb-4039-8635-595f0a1e9442 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.700208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9477ee6-3aeb-4039-8635-595f0a1e9442 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.700316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9477ee6-3aeb-4039-8635-595f0a1e9442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.720793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b9477ee6-3aeb-4039-8635-595f0a1e9442 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:49.722065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b9477ee6-3aeb-4039-8635-595f0a1e9442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:49.769691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:49.771362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:49.784783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1299/2561] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:49.793688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.794086 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.794259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.812441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:49.813971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:49.822046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1300/2562] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:49.826341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:49.834903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3985519-0390-4bf6-a58b-6efcd3663a90 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:49.836956 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9a768-10cd-4e17-b0cf-fafbb35034bb admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:49.839569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:49.840195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.840494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.840773 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.841480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:49.841622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:49.841806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:49.842469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.842749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.843021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] PATH_INFO: `/v3/projects/62d35582391e4f93b4ffac820fc1044d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.843434 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.844232 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d35582391e4f93b4ffac820fc1044d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:49.846256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.855096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1301/2563] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:31:49.859231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:49.869133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fbf92-0c05-4a21-9801-afdc8eb51a24 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:49.873934 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:49.874588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.874824 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.875091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.875766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:49.877667 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.890897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d35582391e4f93b4ffac820fc1044d', 'request_id': 'req-76ce0a0a-8954-4f45-962d-5457953f3ef0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.897497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d35582391e4f93b4ffac820fc1044d', 'request_id': 'req-76ce0a0a-8954-4f45-962d-5457953f3ef0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.902450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1302/2564] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:49 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:49.903169 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d35582391e4f93b4ffac820fc1044d', 'request_id': 'req-76ce0a0a-8954-4f45-962d-5457953f3ef0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.906618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:49.914040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] The token cache is being invalidate because project 62d35582391e4f93b4ffac820fc1044d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:49.914872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.915526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-76ce0a0a-8954-4f45-962d-5457953f3ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:49.917248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1263/2565] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:49 2022] DELETE /identity/v3/projects/62d35582391e4f93b4ffac820fc1044d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:49.921612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73d62-ad30-467d-849f-029a8ec99347 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.921935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73d62-ad30-467d-849f-029a8ec99347 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.922216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d73d62-ad30-467d-849f-029a8ec99347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.940107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-15d73d62-ad30-467d-849f-029a8ec99347 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:49.941300 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-15d73d62-ad30-467d-849f-029a8ec99347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:49.968049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8221c16-aa07-4954-a607-5ede6549435a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:49.972625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:49.973286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:49.973564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:49.973985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:49.974751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:49.976605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:49.997776 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1303/2566] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:49 2022] POST /identity/v3/users => generated 278 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:50.000162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.001724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.002926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1264/2567] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:50.010841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.011127 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.011392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.014664 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179e35a-172f-4252-b5db-8cbfc15b558c admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.019199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.019847 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.020125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.020396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.021112 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.022762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.029415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:50.030702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.032952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1304/2568] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:50.036704 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.038517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1265/2569] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:50.042423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.045918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c558-8e63-4198-add9-ff5a717f8905 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.050984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.051386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e257-8522-4485-9f2a-f3afb13c92fa None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.051565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.051843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.052116 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.052831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.054465 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.056799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.057434 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.057712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.058018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.058739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:50.059046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.060671 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.065571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1305/2570] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:50.070410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.076789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1266/2571] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:31:50.077711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.081162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458e006-8ec9-4d82-88ec-c17c8322fd9f admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.085677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.086940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.087067 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c35bf4-f053-4093-9689-c29a08fc2946 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.087495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.087907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] PATH_INFO: `/v3/projects/b9c6e771cc4e4126afe4c6f8096313fb/users/f96d94847b254a528ee87cb4b7d64b50/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.091762 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a6dc1-ff27-4942-adb4-5d88d328d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.092402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a6dc1-ff27-4942-adb4-5d88d328d1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.092682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a6dc1-ff27-4942-adb4-5d88d328d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.092955 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a6dc1-ff27-4942-adb4-5d88d328d1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.093633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a6dc1-ff27-4942-adb4-5d88d328d1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.095577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a6dc1-ff27-4942-adb4-5d88d328d1c6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.102165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c6e771cc4e4126afe4c6f8096313fb, user_id=f96d94847b254a528ee87cb4b7d64b50, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.104806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.118421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1306/2572] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:50 2022] PUT /identity/v3/projects/b9c6e771cc4e4126afe4c6f8096313fb/users/f96d94847b254a528ee87cb4b7d64b50/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:50.121685 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1267/2573] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:50.125887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.128783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.129097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.129426 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.156007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] MFA Rules not processed for user `f96d94847b254a528ee87cb4b7d64b50`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:50.157204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.186242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0f34e-bab0-4167-a742-b9243602471d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.222352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1268/2574] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:50.226601 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.246740 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.247409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.247689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.247962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.248655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.250628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.271068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1307/2575] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/users => generated 281 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:50.275106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.284654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ee80b-e40f-45d6-9384-18efdffef60e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.289504 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.289825 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cff6c-8172-4dbc-b0a6-72d2554cc9ee None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.290203 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.290481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.290756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.291471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.293065 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.294516 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.295164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.295441 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.295714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.296393 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.298395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.303044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1308/2576] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:50.307296 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.316881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123af368-a2b8-4ee1-af01-39a7714c60ca admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.322616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.323326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.323558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.323846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.329117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1269/2577] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:50.329282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.329282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.329939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.339798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1309/2578] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:50.340996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.350260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eaf1c8-0e45-4e7b-b984-231ee14a6faf admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.390879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa86c6d-2864-4a33-b5d0-6773e662a1e3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.395634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.396287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.396566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.396840 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.397524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.399544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.404129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f191-09b6-476b-a305-954d66f56f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.405049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f191-09b6-476b-a305-954d66f56f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.405327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f191-09b6-476b-a305-954d66f56f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.405602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f191-09b6-476b-a305-954d66f56f98 admin admin] PATH_INFO: `/v3/projects/e41de98ce4ff4d539719c4fe932622ed/users/094f62de589b42e08cbd0387f3ee753d/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.422178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f191-09b6-476b-a305-954d66f56f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41de98ce4ff4d539719c4fe932622ed, user_id=094f62de589b42e08cbd0387f3ee753d, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.424249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1270/2579] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:50.424925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f191-09b6-476b-a305-954d66f56f98 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.428051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.438548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1310/2580] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:50 2022] PUT /identity/v3/projects/e41de98ce4ff4d539719c4fe932622ed/users/094f62de589b42e08cbd0387f3ee753d/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:50.439046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6277-7504-4c6d-9bf3-23dfd5f01a9f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.503598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.503878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.504157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.510742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.511415 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.511697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.511968 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.512708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.514368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.524992 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1271/2581] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:50.529242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.541639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] MFA Rules not processed for user `094f62de589b42e08cbd0387f3ee753d`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:50.541639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.541886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f93a26-6f93-4f6b-a32d-37e6b72eee01 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.545197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.546100 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.546384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.546662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] PATH_INFO: `/v3/projects/cb51c4a85033426caf9f65a4195b2fcf/users/7ab0acc725324e68adee7d1a127c8184/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.561383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb51c4a85033426caf9f65a4195b2fcf, user_id=7ab0acc725324e68adee7d1a127c8184, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.564070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.578621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1272/2582] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:50 2022] PUT /identity/v3/projects/cb51c4a85033426caf9f65a4195b2fcf/users/7ab0acc725324e68adee7d1a127c8184/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:50.582343 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.599070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1311/2583] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:50.630335 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.631693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.643395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93665da-553e-4365-a75a-2357c9bda3c0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.648237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.648939 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.649217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.649488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.650247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.651888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.661408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1273/2584] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:31:50.666047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.675237 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d55a2-4339-4108-b4e4-e487904e0ed7 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.679962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ff6dc-d5fc-4e6d-9bcb-63165bc9553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.681610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff6dc-d5fc-4e6d-9bcb-63165bc9553b admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.681921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff6dc-d5fc-4e6d-9bcb-63165bc9553b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.682196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ff6dc-d5fc-4e6d-9bcb-63165bc9553b admin admin] PATH_INFO: `/v3/projects/cb51c4a85033426caf9f65a4195b2fcf/users/7ab0acc725324e68adee7d1a127c8184/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.684160 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ff6dc-d5fc-4e6d-9bcb-63165bc9553b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb51c4a85033426caf9f65a4195b2fcf, user_id=7ab0acc725324e68adee7d1a127c8184, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.686867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ff6dc-d5fc-4e6d-9bcb-63165bc9553b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.688742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92eef-d832-4cc2-973b-29ca2d0d2cfb None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.696691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1274/2585] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:50 2022] PUT /identity/v3/projects/cb51c4a85033426caf9f65a4195b2fcf/users/7ab0acc725324e68adee7d1a127c8184/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:50.708515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.708801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.709079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.735270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] MFA Rules not processed for user `7ab0acc725324e68adee7d1a127c8184`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:50.736547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.737345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.738042 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.738323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.738596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.793195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.794727 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.803325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1275/2586] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:50.805398 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1312/2587] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:50.815849 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.817268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:50.818070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.828718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab612-a391-4de7-96d4-e5a1135cef4f service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.872662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a209498-a96a-49f0-aafd-07639a2300c4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.876380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.877024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.877308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.877583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.883275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:50.884165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.884442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.884714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] PATH_INFO: `/v3/users/094f62de589b42e08cbd0387f3ee753d` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.885958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] RBAC: Authorizing `identity:delete_user(user_id=094f62de589b42e08cbd0387f3ee753d)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.886812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:50.887905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.888242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:50.897494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1276/2588] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:50.939299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094f62de589b42e08cbd0387f3ee753d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:50.946562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094f62de589b42e08cbd0387f3ee753d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:50.954831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094f62de589b42e08cbd0387f3ee753d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:50.966637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094f62de589b42e08cbd0387f3ee753d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:50.967322 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-05b7b910-110f-4964-8f47-43b0b578555e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094f62de589b42e08cbd0387f3ee753d'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:50.971044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:50.973483 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1313/2589] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:31:50 2022] DELETE /identity/v3/users/094f62de589b42e08cbd0387f3ee753d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:31:50.977979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593036-2048-426d-a448-e241da174f96 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:50.978266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593036-2048-426d-a448-e241da174f96 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:50.978540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593036-2048-426d-a448-e241da174f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:50.980123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146f28-fecd-4bd5-8e45-a710cf147dea service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:50.995720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c5593036-2048-426d-a448-e241da174f96 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:50.996901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c5593036-2048-426d-a448-e241da174f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.027520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.028185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.028503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.028810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.030661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.052888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1314/2590] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:31:51.063133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593036-2048-426d-a448-e241da174f96 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.064526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c5593036-2048-426d-a448-e241da174f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.092119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.093580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.102333 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1277/2591] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:50 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:51.122070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593036-2048-426d-a448-e241da174f96 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.126471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c66e4-47e6-4975-a6fb-7d842c776f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.127120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c66e4-47e6-4975-a6fb-7d842c776f57 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.127741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c66e4-47e6-4975-a6fb-7d842c776f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.128022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c66e4-47e6-4975-a6fb-7d842c776f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.137540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c66e4-47e6-4975-a6fb-7d842c776f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.139079 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c66e4-47e6-4975-a6fb-7d842c776f57 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.148810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1315/2592] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:51.424735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.426209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.444370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a9758-8ecb-4cb6-98f2-ecf1fea9afbf service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.453570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.454466 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.454738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.455004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] PATH_INFO: `/v3/projects/e41de98ce4ff4d539719c4fe932622ed` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.456203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41de98ce4ff4d539719c4fe932622ed)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.458181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.508964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41de98ce4ff4d539719c4fe932622ed', 'request_id': 'req-c09e8acc-8200-4bb2-837e-ce0c24314092'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:51.516015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41de98ce4ff4d539719c4fe932622ed', 'request_id': 'req-c09e8acc-8200-4bb2-837e-ce0c24314092'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:51.521225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41de98ce4ff4d539719c4fe932622ed', 'request_id': 'req-c09e8acc-8200-4bb2-837e-ce0c24314092'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:51.532378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] The token cache is being invalidate because project e41de98ce4ff4d539719c4fe932622ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:31:51.532665 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:51.533298 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c09e8acc-8200-4bb2-837e-ce0c24314092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:31:51.534865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1278/2593] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:31:51 2022] DELETE /identity/v3/projects/e41de98ce4ff4d539719c4fe932622ed => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:51.540374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.540655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.540952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.558841 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:51.560020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.619613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1316/2594] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:51.627121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.627408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.627688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.645189 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:51.646432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:51.654778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1279/2595] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:51.658735 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.668592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b79bd2-9ab3-4143-820a-32867d2778aa None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.673044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.673675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.673977 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.674244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.674951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:31:51.675247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.676874 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.687955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1317/2596] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:31:51.692052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.701264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01366fc9-bd53-4d9a-afa0-5a6f6089a229 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.705948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.706610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.706882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.707149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.707817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.709705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.735332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1280/2597] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:51 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:51.739759 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.749887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1911f-3580-4808-9c00-18d7f75bc737 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.811984 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.812647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.812923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.813194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.813911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.815848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.835479 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1318/2598] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:51 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:51.839596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.849994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2961a4f-f162-4b24-b7ad-1f0b3a24f45c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.854824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.855418 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.855696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.855972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.856692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.858331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.868978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1281/2599] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:51.872866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.882499 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489c712-dcc0-48d8-8a83-624c75faf842 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.887766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d7163-b82a-4772-aca3-01fb0f933b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.888416 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7163-b82a-4772-aca3-01fb0f933b01 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.888694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7163-b82a-4772-aca3-01fb0f933b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.888964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7163-b82a-4772-aca3-01fb0f933b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.889680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d7163-b82a-4772-aca3-01fb0f933b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.891303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d7163-b82a-4772-aca3-01fb0f933b01 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.900730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1319/2600] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:51.904505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:51.914093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfd057-1ae6-4474-b783-3abb15b0e8ff admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:51.919203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:51.920089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.920365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.920633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] PATH_INFO: `/v3/projects/8ffc0364cc87483e919cf1f0b7db747b/users/84c893bbde7d48c5a2c50654ccb31786/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.935159 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffc0364cc87483e919cf1f0b7db747b, user_id=84c893bbde7d48c5a2c50654ccb31786, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:51.937865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:51.950835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1282/2601] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:51 2022] PUT /identity/v3/projects/8ffc0364cc87483e919cf1f0b7db747b/users/84c893bbde7d48c5a2c50654ccb31786/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:51.960930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:51.961237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:51.961539 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:51.987717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] MFA Rules not processed for user `84c893bbde7d48c5a2c50654ccb31786`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:51.988901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:52.048979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1320/2602] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:52.053539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.124803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01d4ec-2a7d-4866-9b0d-711312e56808 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.129282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.129965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.130241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.130510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.131184 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.133619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.157856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1283/2603] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:52 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:52.161881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.172592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d587c4-7ba5-44ff-bf2d-e4e07c6cc025 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.226524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.227219 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.227498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.227770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.228446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.230418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.250114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1321/2604] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:52 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:52.254107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.264529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8f4d-2fd7-4fc8-9da9-53b59606a8ca admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.269455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.270145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.270412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.270713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.271438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.273031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.284070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1284/2605] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:52.288121 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.297982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528966ca-5e6d-4ea3-8b29-7ab4d57fa33a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.302514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b13b43-f1cf-4aae-89bb-fbf899c8a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.303165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13b43-f1cf-4aae-89bb-fbf899c8a383 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.303439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13b43-f1cf-4aae-89bb-fbf899c8a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.303705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13b43-f1cf-4aae-89bb-fbf899c8a383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.304418 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b13b43-f1cf-4aae-89bb-fbf899c8a383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.306636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b13b43-f1cf-4aae-89bb-fbf899c8a383 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.318581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1322/2606] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:52.323439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.333560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6285bba-1137-4aac-822f-2eb564ebd1f7 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.338221 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.339085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.339356 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.339621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] PATH_INFO: `/v3/projects/fb751b90f0ed440ca4d2be56f2324d28/users/69a79e7db9e442e4b2716ba877c77e7d/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.353504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb751b90f0ed440ca4d2be56f2324d28, user_id=69a79e7db9e442e4b2716ba877c77e7d, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.356215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.369489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1285/2607] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:52 2022] PUT /identity/v3/projects/fb751b90f0ed440ca4d2be56f2324d28/users/69a79e7db9e442e4b2716ba877c77e7d/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:52.381541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.382108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.382581 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.412230 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] MFA Rules not processed for user `69a79e7db9e442e4b2716ba877c77e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:52.413497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:52.476171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1323/2608] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:52.481336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.542087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717442-c3fd-4949-bdc8-1c6bbbbe08f2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.546781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.547432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.547714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.547989 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.548678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.550639 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.574473 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1286/2609] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:31:52 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:31:52.578603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.589676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c488-7278-4326-b63c-2182c91c7a60 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.644951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.645766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.646100 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.646377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.647215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.649861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.669354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1324/2610] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:31:52 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:31:52.673435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.690823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825c4f3-6ee0-4061-a6f6-053cca49840c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.696119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.696818 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.697349 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.697638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.698428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.700081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.710265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1287/2611] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:52.715158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.725109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9ba2-be15-49fe-bcc0-83409bfbdcb5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.729863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.730736 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.731006 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.731271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] PATH_INFO: `/v3/projects/9035546383a14a588adf9fdc718ad349/users/21b1959586d3434eaa4bcd62815e16d3/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.745941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9035546383a14a588adf9fdc718ad349, user_id=21b1959586d3434eaa4bcd62815e16d3, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.748657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.761867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1325/2612] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:52 2022] PUT /identity/v3/projects/9035546383a14a588adf9fdc718ad349/users/21b1959586d3434eaa4bcd62815e16d3/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:52.765877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.776389 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c752697-2d6c-49a0-9f47-9f68897f5a94 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.828352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43385d4a-88e9-44f0-bc97-d6f0a8c49c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.828994 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43385d4a-88e9-44f0-bc97-d6f0a8c49c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.829270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43385d4a-88e9-44f0-bc97-d6f0a8c49c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.829536 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43385d4a-88e9-44f0-bc97-d6f0a8c49c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.830274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43385d4a-88e9-44f0-bc97-d6f0a8c49c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.831862 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43385d4a-88e9-44f0-bc97-d6f0a8c49c66 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.840954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1288/2613] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:31:52.845019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.855495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ffedd-68d2-4a00-a125-a94427571876 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:52.860318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:52.861188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.861868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.862144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] PATH_INFO: `/v3/projects/9035546383a14a588adf9fdc718ad349/users/21b1959586d3434eaa4bcd62815e16d3/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.864105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9035546383a14a588adf9fdc718ad349, user_id=21b1959586d3434eaa4bcd62815e16d3, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:52.866819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:52.877365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1326/2614] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:31:52 2022] PUT /identity/v3/projects/9035546383a14a588adf9fdc718ad349/users/21b1959586d3434eaa4bcd62815e16d3/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:31:52.887205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:52.887428 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:52.887696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:52.912547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] MFA Rules not processed for user `21b1959586d3434eaa4bcd62815e16d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:31:52.913724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:52.978660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1289/2615] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:31:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:31:52.989649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:52.991388 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:53.046130 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f87e6-ed3b-4026-92de-a1f073b26b3b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:53.049661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:53.050304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:53.050577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:53.050844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:53.102985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:53.104406 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:53.114689 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1327/2616] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:31:54.641087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:54.642633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:31:54.655257 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd100e9-e33f-4ff4-b62a-1fd5eea3e733 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:54.659010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:54.659653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:54.659933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:54.660209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:54.718126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:54.720463 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:54.731236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1290/2617] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:31:57.290072 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:31:57.299013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903550-7034-41df-ad13-aeea90b0f6a1 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:31:57.302637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993e311-361e-4701-9c59-c9697728bb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:31:57.303268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993e311-361e-4701-9c59-c9697728bb09 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:31:57.303548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993e311-361e-4701-9c59-c9697728bb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:31:57.303823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993e311-361e-4701-9c59-c9697728bb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:31:57.313237 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993e311-361e-4701-9c59-c9697728bb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:31:57.314744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993e311-361e-4701-9c59-c9697728bb09 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:31:57.324528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1328/2618] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:31:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:01.331674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:01.408623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea724f1-c43a-4b8d-8595-99ed72f63895 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:01.413838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:01.414871 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:01.415243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:01.416256 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] PATH_INFO: `/v3/users/84c893bbde7d48c5a2c50654ccb31786` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:01.417839 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c893bbde7d48c5a2c50654ccb31786)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:01.420018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:01.473029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c893bbde7d48c5a2c50654ccb31786'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:01.486826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c893bbde7d48c5a2c50654ccb31786'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:01.496678 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c893bbde7d48c5a2c50654ccb31786'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:01.497566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c893bbde7d48c5a2c50654ccb31786'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:01.512560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c893bbde7d48c5a2c50654ccb31786'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:01.523404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1291/2619] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:01 2022] DELETE /identity/v3/users/84c893bbde7d48c5a2c50654ccb31786 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:01.528069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:01.528536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:01.528820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:01.551626 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:01.553571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:01.623337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1329/2620] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:01.633544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:01.635284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:01.700698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cff9af-5f65-411c-a436-d53a73c7ddf9 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:01.704484 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:01.705124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:01.705407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:01.705673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:01.714634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:01.716077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:01.727340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1292/2621] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:01.987340 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:01.989176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:02.003226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cf745-6bf0-40b0-920d-0facefc200d6 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:02.008807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:02.010493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:02.010724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:02.010989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] PATH_INFO: `/v3/projects/8ffc0364cc87483e919cf1f0b7db747b` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:02.012194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffc0364cc87483e919cf1f0b7db747b)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:02.014148 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:02.057652 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffc0364cc87483e919cf1f0b7db747b', 'request_id': 'req-089e7367-9556-436c-9b03-a39a0d8edd81'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.063916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffc0364cc87483e919cf1f0b7db747b', 'request_id': 'req-089e7367-9556-436c-9b03-a39a0d8edd81'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.069260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffc0364cc87483e919cf1f0b7db747b', 'request_id': 'req-089e7367-9556-436c-9b03-a39a0d8edd81'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.080962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] The token cache is being invalidate because project 8ffc0364cc87483e919cf1f0b7db747b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:02.081249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.081927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.083458 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1330/2622] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:01 2022] DELETE /identity/v3/projects/8ffc0364cc87483e919cf1f0b7db747b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:02.088118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:02.097445 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317fc7d-07e2-4a31-b027-66655cc4b7d2 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:02.155806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:02.156670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:02.156949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:02.157223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] PATH_INFO: `/v3/users/69a79e7db9e442e4b2716ba877c77e7d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:02.158414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a79e7db9e442e4b2716ba877c77e7d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:02.160448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:02.204505 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a79e7db9e442e4b2716ba877c77e7d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.211050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a79e7db9e442e4b2716ba877c77e7d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.219547 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a79e7db9e442e4b2716ba877c77e7d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.220149 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a79e7db9e442e4b2716ba877c77e7d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.232248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a79e7db9e442e4b2716ba877c77e7d'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.237934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1293/2623] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:02 2022] DELETE /identity/v3/users/69a79e7db9e442e4b2716ba877c77e7d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:02.498905 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:02.501003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:02.516236 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7367-9556-436c-9b03-a39a0d8edd81 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:02.576486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:02.577338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:02.577620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:02.577927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] PATH_INFO: `/v3/projects/fb751b90f0ed440ca4d2be56f2324d28` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:02.579608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb751b90f0ed440ca4d2be56f2324d28)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:02.581537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:02.629679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb751b90f0ed440ca4d2be56f2324d28', 'request_id': 'req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.645948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb751b90f0ed440ca4d2be56f2324d28', 'request_id': 'req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.645948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb751b90f0ed440ca4d2be56f2324d28', 'request_id': 'req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.656345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] The token cache is being invalidate because project fb751b90f0ed440ca4d2be56f2324d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:02.656811 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.657477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.659471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1331/2624] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:02 2022] DELETE /identity/v3/projects/fb751b90f0ed440ca4d2be56f2324d28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:02.663528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:02.666860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:02.680290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa683095-9f23-46f1-95e7-79fa41e45be6 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:02.744132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:02.744635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:02.744915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:02.745248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] PATH_INFO: `/v3/users/21b1959586d3434eaa4bcd62815e16d3` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:02.746407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b1959586d3434eaa4bcd62815e16d3)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:02.748553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:02.801325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b1959586d3434eaa4bcd62815e16d3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.808879 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b1959586d3434eaa4bcd62815e16d3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.824584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b1959586d3434eaa4bcd62815e16d3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.825331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b1959586d3434eaa4bcd62815e16d3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.838835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b1959586d3434eaa4bcd62815e16d3'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:02.848201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1294/2625] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:02 2022] DELETE /identity/v3/users/21b1959586d3434eaa4bcd62815e16d3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:03.159810 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:03.161675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:03.176571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7020e52-cd5f-43e5-a353-3bb0f03bdf0e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:03.233612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:03.234494 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:03.234768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:03.235035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] PATH_INFO: `/v3/projects/9035546383a14a588adf9fdc718ad349` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:03.236194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9035546383a14a588adf9fdc718ad349)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:03.238143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:03.284029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9035546383a14a588adf9fdc718ad349', 'request_id': 'req-22f714f8-a958-4d59-9e1e-2df6df9fec85'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:03.290926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9035546383a14a588adf9fdc718ad349', 'request_id': 'req-22f714f8-a958-4d59-9e1e-2df6df9fec85'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:03.297064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9035546383a14a588adf9fdc718ad349', 'request_id': 'req-22f714f8-a958-4d59-9e1e-2df6df9fec85'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:03.307833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] The token cache is being invalidate because project 9035546383a14a588adf9fdc718ad349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:03.308136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:03.308913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:03.311136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1332/2626] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:03 2022] DELETE /identity/v3/projects/9035546383a14a588adf9fdc718ad349 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:08.605957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:08.607438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:08.662785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79a5fe-eed9-48af-ae3e-5c6d44cffc73 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:08.711795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:08.712361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:08.712637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:08.712906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:08.715213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:08.778361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:08.779804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:08.789889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1295/2627] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:09.302012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:09.305017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.328423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f714f8-a958-4d59-9e1e-2df6df9fec85 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:09.335019 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:09.335978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.336353 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.336513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] PATH_INFO: `/v3/users/3ab541e9017c4ece9432f1fedde0f64e` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.337962 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab541e9017c4ece9432f1fedde0f64e)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:09.340885 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:09.394224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab541e9017c4ece9432f1fedde0f64e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.401420 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab541e9017c4ece9432f1fedde0f64e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.412343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab541e9017c4ece9432f1fedde0f64e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.425157 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab541e9017c4ece9432f1fedde0f64e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.425894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab541e9017c4ece9432f1fedde0f64e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.431671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1333/2628] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:09 2022] DELETE /identity/v3/users/3ab541e9017c4ece9432f1fedde0f64e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:09.585531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:09.586975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.599814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e906a7-5149-4877-9679-bf17c848a81c service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:09.608277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:09.610007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.660374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:09.661245 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.661539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.661838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] PATH_INFO: `/v3/users/f96d94847b254a528ee87cb4b7d64b50` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.663094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96d94847b254a528ee87cb4b7d64b50)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:09.665191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:09.675927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e443-3fcf-4d9f-b5b7-7f686b26eb0c admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:09.680600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:09.681485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.681786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.682063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] PATH_INFO: `/v3/projects/e07bcaeeb617491689c13594914b370e` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.683250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07bcaeeb617491689c13594914b370e)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:09.685717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:09.712627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96d94847b254a528ee87cb4b7d64b50'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.720961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96d94847b254a528ee87cb4b7d64b50'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.728491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96d94847b254a528ee87cb4b7d64b50'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.729167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96d94847b254a528ee87cb4b7d64b50'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.736391 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07bcaeeb617491689c13594914b370e', 'request_id': 'req-567fcbe3-3792-4c96-afad-ee143302aefd'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.741396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-a489c54c-3f6d-4501-9a84-454b7351d200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96d94847b254a528ee87cb4b7d64b50'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.743532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07bcaeeb617491689c13594914b370e', 'request_id': 'req-567fcbe3-3792-4c96-afad-ee143302aefd'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.748177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1296/2629] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:09 2022] DELETE /identity/v3/users/f96d94847b254a528ee87cb4b7d64b50 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:09.751169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07bcaeeb617491689c13594914b370e', 'request_id': 'req-567fcbe3-3792-4c96-afad-ee143302aefd'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.752566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.752858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.753130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.760135 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] The token cache is being invalidate because project e07bcaeeb617491689c13594914b370e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:09.760451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.761090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:09.762868 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1334/2630] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:09 2022] DELETE /identity/v3/projects/e07bcaeeb617491689c13594914b370e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:09.770331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:09.771574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.835540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1297/2631] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:09.846165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:09.847635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:09.911380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fcbe3-3792-4c96-afad-ee143302aefd admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:09.960383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:09.961029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:09.961305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:09.961575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:09.970978 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:09.972419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:09.981714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1335/2632] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:10.251140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:10.252699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:10.266325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbda729-52ee-4e26-8a55-ee70037d0ba4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:10.272305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:10.272801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:10.273075 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:10.273344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] PATH_INFO: `/v3/projects/b9c6e771cc4e4126afe4c6f8096313fb` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:10.274577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c6e771cc4e4126afe4c6f8096313fb)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:10.276574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:10.335622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c6e771cc4e4126afe4c6f8096313fb', 'request_id': 'req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.342282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c6e771cc4e4126afe4c6f8096313fb', 'request_id': 'req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.347981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c6e771cc4e4126afe4c6f8096313fb', 'request_id': 'req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.359399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] The token cache is being invalidate because project b9c6e771cc4e4126afe4c6f8096313fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:10.359691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.360339 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.362021 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1298/2633] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:10 2022] DELETE /identity/v3/projects/b9c6e771cc4e4126afe4c6f8096313fb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:10.365960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:10.376035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35695dfd-0ffe-4600-b14d-33d54b5d0dbc service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:10.431245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:10.432115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:10.432394 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:10.432668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] PATH_INFO: `/v3/users/7ab0acc725324e68adee7d1a127c8184` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:10.434412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab0acc725324e68adee7d1a127c8184)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:10.436370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:10.482633 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab0acc725324e68adee7d1a127c8184'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.489421 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab0acc725324e68adee7d1a127c8184'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.496862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab0acc725324e68adee7d1a127c8184'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.508240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab0acc725324e68adee7d1a127c8184'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.508878 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ad147d76-9ec0-440b-9f8e-fbb5e88d2dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab0acc725324e68adee7d1a127c8184'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.515183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1336/2634] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:10 2022] DELETE /identity/v3/users/7ab0acc725324e68adee7d1a127c8184 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:10.772886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:10.774392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:10.787695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cf2ae-ae93-49b4-8e8c-2e7bb8bce937 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:10.843877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:10.844735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:10.845014 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:10.845287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] PATH_INFO: `/v3/projects/cb51c4a85033426caf9f65a4195b2fcf` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:10.846480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb51c4a85033426caf9f65a4195b2fcf)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:10.848413 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:10.892259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb51c4a85033426caf9f65a4195b2fcf', 'request_id': 'req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.898872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb51c4a85033426caf9f65a4195b2fcf', 'request_id': 'req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.904734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb51c4a85033426caf9f65a4195b2fcf', 'request_id': 'req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.915240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] The token cache is being invalidate because project cb51c4a85033426caf9f65a4195b2fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:10.915527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.916163 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-d620feb7-1ca8-4c78-9e33-08fadb9b5e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:10.917727 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1299/2635] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:10 2022] DELETE /identity/v3/projects/cb51c4a85033426caf9f65a4195b2fcf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:10.922580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:10.922866 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:10.923141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:10.942167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:10.943378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:11.000751 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1337/2636] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:11.008274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.008562 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.008841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.027179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:11.028321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:11.036199 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1300/2637] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:11.040131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.049471 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7cd7-220c-4e3f-bd19-2401adc6a46a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.054259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.054907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.055185 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.055453 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.056201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:11.056501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.058156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.069953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1338/2638] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:11.074921 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.083897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de009bd-b6b2-44d4-92fa-71d2aff225d4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.088576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.089217 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.089496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.089832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.090532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.092437 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.116276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1301/2639] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:11.120215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.130370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e14a5-edac-4bee-b19e-471e8744cf38 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.183941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.184618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.184875 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.185240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.186139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.188049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.210070 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1339/2640] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:11.214235 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.224306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652eb3b-8f7b-459d-a588-d1b51dbf2576 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.228909 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.229561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.229882 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.230179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.230900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.232503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.242510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1302/2641] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:11.246822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.256771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e3781-09dc-4fc4-9ccb-ab62a1fc38e9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.261362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6824f-cba9-4921-880b-f8710f7ebba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.262650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6824f-cba9-4921-880b-f8710f7ebba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.262925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6824f-cba9-4921-880b-f8710f7ebba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.263195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6824f-cba9-4921-880b-f8710f7ebba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.263909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6824f-cba9-4921-880b-f8710f7ebba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.265475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6824f-cba9-4921-880b-f8710f7ebba6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.274956 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1340/2642] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:11.279023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.288506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fa72-6049-4c74-811d-1e32829befad admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.293640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.294526 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.294804 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.295072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] PATH_INFO: `/v3/projects/00d88109d1e04c68ae38513c6ea7197d/users/3a471621b8b2475bbc049a7f010e96c4/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.309550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d88109d1e04c68ae38513c6ea7197d, user_id=3a471621b8b2475bbc049a7f010e96c4, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.312279 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.325261 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1303/2643] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:11 2022] PUT /identity/v3/projects/00d88109d1e04c68ae38513c6ea7197d/users/3a471621b8b2475bbc049a7f010e96c4/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:11.336126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.336407 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.336681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.363068 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] MFA Rules not processed for user `3a471621b8b2475bbc049a7f010e96c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:11.364341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:11.430913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1341/2644] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:11.436410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.513407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31c2c-0f70-43d3-9908-89235a9b0eea admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.518248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.518924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.519200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.519469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.520180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.522711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.549632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1304/2645] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:11.553464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.565097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429e98b-6645-4294-9ee2-7d4a2771c274 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.625877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.626522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.626798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.627074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.627846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.629828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.649646 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1342/2646] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:11.654611 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.666267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ac43a-7886-49fe-a4b0-2288a66f6642 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.670948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.671606 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.671886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.672161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.672891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.674549 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.686345 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1305/2647] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:11.690396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.701248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703ae5-a227-426e-a8d4-746fd18811fb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.705921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.706787 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.707063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.707331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] PATH_INFO: `/v3/projects/76358d3253d54d5498cf3c4496e3926c/users/a9a738be6d19471e8fcef583d423c090/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.721325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76358d3253d54d5498cf3c4496e3926c, user_id=a9a738be6d19471e8fcef583d423c090, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.724026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.736676 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1343/2648] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:11 2022] PUT /identity/v3/projects/76358d3253d54d5498cf3c4496e3926c/users/a9a738be6d19471e8fcef583d423c090/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:11.740540 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.750765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c778-b157-471d-a6a6-f7dff6c4c19b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.803209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaae22-8eec-42c9-8111-a337c849159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.803850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaae22-8eec-42c9-8111-a337c849159d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.804063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaae22-8eec-42c9-8111-a337c849159d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.804336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaae22-8eec-42c9-8111-a337c849159d admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.805065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaae22-8eec-42c9-8111-a337c849159d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.806694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaae22-8eec-42c9-8111-a337c849159d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.816490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1306/2649] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:11.820628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.831447 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ffb2c-7745-4e88-a3db-58a4e7226f53 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:11.836020 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:11.836891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.837168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.837439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] PATH_INFO: `/v3/projects/76358d3253d54d5498cf3c4496e3926c/users/a9a738be6d19471e8fcef583d423c090/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.839455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76358d3253d54d5498cf3c4496e3926c, user_id=a9a738be6d19471e8fcef583d423c090, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:11.842235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:11.851939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1344/2650] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:11 2022] PUT /identity/v3/projects/76358d3253d54d5498cf3c4496e3926c/users/a9a738be6d19471e8fcef583d423c090/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:11.861798 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:11.862091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:11.862370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:11.888277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] MFA Rules not processed for user `a9a738be6d19471e8fcef583d423c090`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:11.889485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:11.953908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1307/2651] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:11.964973 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:11.966666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:12.030216 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58bb5d-0d8c-44d5-a6f1-a62921b28ed8 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:12.034013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:12.034644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:12.034920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:12.035187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:12.044706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:12.046173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:12.055364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1345/2652] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:12.124675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:12.134196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d070dab-6c65-4def-836d-a0b5f94d5708 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:12.137851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51137a7b-d784-478f-b809-632aabb63981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:12.138492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51137a7b-d784-478f-b809-632aabb63981 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:12.138770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51137a7b-d784-478f-b809-632aabb63981 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:12.139041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51137a7b-d784-478f-b809-632aabb63981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:12.193183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51137a7b-d784-478f-b809-632aabb63981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:12.194649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51137a7b-d784-478f-b809-632aabb63981 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:12.203915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1308/2653] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:14.869536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:14.928952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ff413-e8e4-4f3f-a6e8-18686144029d service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:14.933987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:14.934838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:14.935113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:14.935384 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] PATH_INFO: `/v3/users/3a471621b8b2475bbc049a7f010e96c4` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:14.936548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a471621b8b2475bbc049a7f010e96c4)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:14.938502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:14.982562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a471621b8b2475bbc049a7f010e96c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:14.989002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a471621b8b2475bbc049a7f010e96c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:14.996656 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a471621b8b2475bbc049a7f010e96c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.007958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a471621b8b2475bbc049a7f010e96c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.008582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a471621b8b2475bbc049a7f010e96c4'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.014867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1346/2654] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:14 2022] DELETE /identity/v3/users/3a471621b8b2475bbc049a7f010e96c4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:15.019539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:15.020044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:15.020164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:15.037138 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:15.038381 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:15.094066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1309/2655] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:15.103641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:15.105937 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:15.160543 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337256-2870-4052-9a4a-854331e095ab admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:15.164279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:15.164913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:15.165192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:15.165464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:15.174850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:15.176281 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:15.186260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1347/2656] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:15.454118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:15.455515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:15.468384 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0e544-2e7e-414d-bf00-22c5e2b25a84 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:15.473167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:15.474131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:15.474412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:15.474682 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] PATH_INFO: `/v3/projects/00d88109d1e04c68ae38513c6ea7197d` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:15.477289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d88109d1e04c68ae38513c6ea7197d)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:15.479427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:15.528885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d88109d1e04c68ae38513c6ea7197d', 'request_id': 'req-99e14724-6af7-4780-8058-f06573c6902a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.535743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d88109d1e04c68ae38513c6ea7197d', 'request_id': 'req-99e14724-6af7-4780-8058-f06573c6902a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.541060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d88109d1e04c68ae38513c6ea7197d', 'request_id': 'req-99e14724-6af7-4780-8058-f06573c6902a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.552360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] The token cache is being invalidate because project 00d88109d1e04c68ae38513c6ea7197d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:15.552644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.553266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.554868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1310/2657] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:15 2022] DELETE /identity/v3/projects/00d88109d1e04c68ae38513c6ea7197d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:15.558861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:15.570428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c42862-ca76-4774-8a0e-2b1f6fb9a914 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:15.629324 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:15.630290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:15.630569 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:15.630842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] PATH_INFO: `/v3/users/a9a738be6d19471e8fcef583d423c090` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:15.632052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a738be6d19471e8fcef583d423c090)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:15.634014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:15.676713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a738be6d19471e8fcef583d423c090'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.683150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a738be6d19471e8fcef583d423c090'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.689895 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a738be6d19471e8fcef583d423c090'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.702268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a738be6d19471e8fcef583d423c090'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.702912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c5076e4-40bd-442f-ac1a-61bf773478d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a738be6d19471e8fcef583d423c090'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:15.708675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1348/2658] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:15 2022] DELETE /identity/v3/users/a9a738be6d19471e8fcef583d423c090 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:15.974236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:15.975797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:15.989395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e14724-6af7-4780-8058-f06573c6902a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.049444 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.050271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.050550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.050821 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] PATH_INFO: `/v3/projects/76358d3253d54d5498cf3c4496e3926c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.052094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76358d3253d54d5498cf3c4496e3926c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.054097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.105093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76358d3253d54d5498cf3c4496e3926c', 'request_id': 'req-f7864353-1470-416c-b337-5a8197c22c18'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:16.121465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76358d3253d54d5498cf3c4496e3926c', 'request_id': 'req-f7864353-1470-416c-b337-5a8197c22c18'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:16.127391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76358d3253d54d5498cf3c4496e3926c', 'request_id': 'req-f7864353-1470-416c-b337-5a8197c22c18'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:16.140047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] The token cache is being invalidate because project 76358d3253d54d5498cf3c4496e3926c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:16.140335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:16.141095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-f7864353-1470-416c-b337-5a8197c22c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:16.142765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1311/2659] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:15 2022] DELETE /identity/v3/projects/76358d3253d54d5498cf3c4496e3926c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:16.147752 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.148308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.148308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.171700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:16.172892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:16.232352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1349/2660] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:16.240028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.240316 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.240591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.258752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:16.259934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:16.268288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1312/2661] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:16.272189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.281716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc4a4d-3b10-4714-97df-e315f929e0bc None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.286330 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.286970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.287247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.287524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.288375 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:16.288682 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.290347 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.301470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1350/2662] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:16.305589 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.315197 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b3e79-c818-4ab6-922e-bf33bd424f52 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.319858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.320498 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.320774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.321044 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.322023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.324737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.348841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1313/2663] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:16.352981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.362750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb21b7-5cb4-43fb-9a47-1b9674fd7d37 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.419208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.419914 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.420191 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.420467 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.421158 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.423123 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.442548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1351/2664] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:16.446624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.457400 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a3761-639b-4227-a8ea-0a7b4d51b939 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.462051 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.462702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.462979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.463251 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.463972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.465566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.475492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1314/2665] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:16.479168 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.488971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231075a-57e7-445e-8fb3-5c1b0b42a150 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.493550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17545-152f-4cb2-8745-3f26b937e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.494225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17545-152f-4cb2-8745-3f26b937e5be admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.494517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17545-152f-4cb2-8745-3f26b937e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.494768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17545-152f-4cb2-8745-3f26b937e5be admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.495482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17545-152f-4cb2-8745-3f26b937e5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.498743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17545-152f-4cb2-8745-3f26b937e5be admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.508785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1352/2666] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:16.513672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.523672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e587bd-21e1-42a9-a4b7-5ce50621aa2e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.528284 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.529153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.529431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.529702 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] PATH_INFO: `/v3/projects/df27c5ec1bc54bc4aeb10245707bdcf7/users/ef43d79c02dc4a9694e9ebd288fedbc2/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.545057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df27c5ec1bc54bc4aeb10245707bdcf7, user_id=ef43d79c02dc4a9694e9ebd288fedbc2, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.547778 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.560788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1315/2667] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:16 2022] PUT /identity/v3/projects/df27c5ec1bc54bc4aeb10245707bdcf7/users/ef43d79c02dc4a9694e9ebd288fedbc2/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:16.572074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.572355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.572650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.598049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] MFA Rules not processed for user `ef43d79c02dc4a9694e9ebd288fedbc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:16.599313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:16.660720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1353/2668] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:16.665126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.723092 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e38b5-c971-4516-88db-b18eb28c531c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.727691 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.728340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.728617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.728888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.729559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.732033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.756576 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1316/2669] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:16.760522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.770860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde880e-f8f3-4255-a727-8240aa6eb25c None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.825059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.825732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.826041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.826314 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.827151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.829087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.850927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1354/2670] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:16.852181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.862835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ca69a-5949-4e3b-a6da-6962d172cf72 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.867351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.867991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.868263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.868532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.869236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.871824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.881746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1317/2671] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:16.885397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.895052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b5a8-4fb7-420a-ba2e-4584e722fe69 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.899881 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e4b48-6ee5-46ec-a2e9-3cd8e7297cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.900537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e4b48-6ee5-46ec-a2e9-3cd8e7297cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.900813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e4b48-6ee5-46ec-a2e9-3cd8e7297cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.901080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e4b48-6ee5-46ec-a2e9-3cd8e7297cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.902477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e4b48-6ee5-46ec-a2e9-3cd8e7297cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.910779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e4b48-6ee5-46ec-a2e9-3cd8e7297cd2 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.925647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1355/2672] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:16.926838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:16.936493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec6800-2a03-4612-86ea-3c027a30d435 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:16.941049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:16.941941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.942212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.942475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] PATH_INFO: `/v3/projects/abab5b6782794102ae76c770aecba8c9/users/2aff4b73b06b445abbae780ff224dda8/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:16.956303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=abab5b6782794102ae76c770aecba8c9, user_id=2aff4b73b06b445abbae780ff224dda8, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:16.959018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:16.972209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1318/2673] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:16 2022] PUT /identity/v3/projects/abab5b6782794102ae76c770aecba8c9/users/2aff4b73b06b445abbae780ff224dda8/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:16.982655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:16.985907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:16.985907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.015012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] MFA Rules not processed for user `2aff4b73b06b445abbae780ff224dda8`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:17.016208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:17.077374 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1356/2674] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:17.081858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.141087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b7432-7ec9-4413-9d39-a2765561b0ed admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.145722 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.146399 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.146677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.146948 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.147628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.149573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.175757 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1319/2675] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:17 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:17.179960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.196361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49244c8-e666-481d-9add-2bf86e53f7d3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.249892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.250565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.250843 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.251114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.251792 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.254120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.273131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1357/2676] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:17 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:17.277206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.287359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06096ac0-56ab-469a-b491-5fbcdd582016 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.292029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.293183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.294319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.294319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.294560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.296129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.306660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1320/2677] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:17.311562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.321435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66640aeb-15fb-4f98-9837-ed0ef84d48b7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.326550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.327469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.327695 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.327974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] PATH_INFO: `/v3/projects/7eda17f4ee4d4a409ba28b8438d6f295/users/929f768839754f09a333dd6c65d9ad94/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.343592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eda17f4ee4d4a409ba28b8438d6f295, user_id=929f768839754f09a333dd6c65d9ad94, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.346344 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.359015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1358/2678] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:17 2022] PUT /identity/v3/projects/7eda17f4ee4d4a409ba28b8438d6f295/users/929f768839754f09a333dd6c65d9ad94/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:17.362942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.373440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f619c09-37b0-4352-a34e-220e11d50e81 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.434504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70191bcf-d3f8-4af9-8648-1fc192020d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.435306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70191bcf-d3f8-4af9-8648-1fc192020d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.435586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70191bcf-d3f8-4af9-8648-1fc192020d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.435857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70191bcf-d3f8-4af9-8648-1fc192020d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.436574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70191bcf-d3f8-4af9-8648-1fc192020d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.438200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70191bcf-d3f8-4af9-8648-1fc192020d7f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.448002 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1321/2679] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:17.452575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.462730 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b0fc-c53c-4828-ba8e-ce45514d250d admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.470077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.471001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.471284 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.471554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] PATH_INFO: `/v3/projects/7eda17f4ee4d4a409ba28b8438d6f295/users/929f768839754f09a333dd6c65d9ad94/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.473575 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eda17f4ee4d4a409ba28b8438d6f295, user_id=929f768839754f09a333dd6c65d9ad94, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.476301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.487482 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1359/2680] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:17 2022] PUT /identity/v3/projects/7eda17f4ee4d4a409ba28b8438d6f295/users/929f768839754f09a333dd6c65d9ad94/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:17.498108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.498388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.498657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.529645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] MFA Rules not processed for user `929f768839754f09a333dd6c65d9ad94`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:17.530906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:17.611040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1322/2681] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:17.623273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:17.625133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:17.682534 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4cf3e-c321-4ae4-aac3-c87500446b77 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:17.686271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:17.686911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:17.687187 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:17.687455 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:17.696456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:17.698243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:17.707997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1360/2682] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:18.232216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:18.233667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:18.245066 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47e57e-3f8d-455c-9d4f-73d82c83b802 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:18.248553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:18.249175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:18.249449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:18.249714 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:18.302897 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:18.304322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:18.314674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1323/2683] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:22.354900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:22.363631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4288-b689-44e7-ac87-5cdfa5d5c495 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:22.367328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade3104-df65-4dd9-bd8c-6ff9269a2079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:22.367951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade3104-df65-4dd9-bd8c-6ff9269a2079 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:22.368258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade3104-df65-4dd9-bd8c-6ff9269a2079 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:22.368527 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade3104-df65-4dd9-bd8c-6ff9269a2079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:22.422908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade3104-df65-4dd9-bd8c-6ff9269a2079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:22.424393 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade3104-df65-4dd9-bd8c-6ff9269a2079 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:22.433012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1361/2684] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:24.577190 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:24.637919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575baa7-efa1-4491-82e0-49e0a6b3682d service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:24.642372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:24.643227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.643496 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.643770 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] PATH_INFO: `/v3/users/ef43d79c02dc4a9694e9ebd288fedbc2` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.644923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef43d79c02dc4a9694e9ebd288fedbc2)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:24.646892 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:24.699360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef43d79c02dc4a9694e9ebd288fedbc2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:24.705917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef43d79c02dc4a9694e9ebd288fedbc2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:24.713668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef43d79c02dc4a9694e9ebd288fedbc2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:24.714475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef43d79c02dc4a9694e9ebd288fedbc2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:24.727865 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef43d79c02dc4a9694e9ebd288fedbc2'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:24.735431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1324/2685] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:24 2022] DELETE /identity/v3/users/ef43d79c02dc4a9694e9ebd288fedbc2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:24.740607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.741332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.741332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.758140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:24.759533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:24.817511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1362/2686] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:24.827938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:24.829410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:24.885794 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2b446-d04a-42d1-8b73-c31b77d7eb5a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:24.890180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:24.890768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:24.891046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:24.891325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:24.901018 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:24.903076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:24.912390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1325/2687] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:25.177198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:25.178671 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:25.191145 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b158b4-22bc-450d-8418-e4489ec82a03 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:25.195896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:25.197055 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:25.197329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:25.197595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] PATH_INFO: `/v3/projects/df27c5ec1bc54bc4aeb10245707bdcf7` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:25.205872 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df27c5ec1bc54bc4aeb10245707bdcf7)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:25.207916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:25.254195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df27c5ec1bc54bc4aeb10245707bdcf7', 'request_id': 'req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.264446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df27c5ec1bc54bc4aeb10245707bdcf7', 'request_id': 'req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.270151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df27c5ec1bc54bc4aeb10245707bdcf7', 'request_id': 'req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.281271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] The token cache is being invalidate because project df27c5ec1bc54bc4aeb10245707bdcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:25.281554 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.282215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.283761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1363/2688] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:25 2022] DELETE /identity/v3/projects/df27c5ec1bc54bc4aeb10245707bdcf7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:25.287627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:25.297584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711c08c-00af-48a2-b4b6-eb3a23852e0f service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:25.359108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:25.359975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:25.360250 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:25.360519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] PATH_INFO: `/v3/users/2aff4b73b06b445abbae780ff224dda8` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:25.361692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aff4b73b06b445abbae780ff224dda8)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:25.363640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:25.407319 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aff4b73b06b445abbae780ff224dda8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.415093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aff4b73b06b445abbae780ff224dda8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.422511 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aff4b73b06b445abbae780ff224dda8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.423058 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aff4b73b06b445abbae780ff224dda8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.438633 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aff4b73b06b445abbae780ff224dda8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.445924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1326/2689] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:25 2022] DELETE /identity/v3/users/2aff4b73b06b445abbae780ff224dda8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:25.720524 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:25.722346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:25.737546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b0dd1-a92b-4b76-9cdd-040b2a56f0e1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:25.798381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:25.799240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:25.799520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:25.799794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] PATH_INFO: `/v3/projects/abab5b6782794102ae76c770aecba8c9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:25.800982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abab5b6782794102ae76c770aecba8c9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:25.802947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:25.846714 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abab5b6782794102ae76c770aecba8c9', 'request_id': 'req-7a43db88-437a-4954-a5d0-80f225a64237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.854409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abab5b6782794102ae76c770aecba8c9', 'request_id': 'req-7a43db88-437a-4954-a5d0-80f225a64237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.860968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abab5b6782794102ae76c770aecba8c9', 'request_id': 'req-7a43db88-437a-4954-a5d0-80f225a64237'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.872382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] The token cache is being invalidate because project abab5b6782794102ae76c770aecba8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:25.872662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.873290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:25.874861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1364/2690] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:25 2022] DELETE /identity/v3/projects/abab5b6782794102ae76c770aecba8c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:25.878983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:25.880658 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:25.897964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a78ba-dd70-4b25-939e-ecd0655ec960 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:25.952166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:25.953025 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:25.953297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:25.953564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] PATH_INFO: `/v3/users/929f768839754f09a333dd6c65d9ad94` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:25.954758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929f768839754f09a333dd6c65d9ad94)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:25.956727 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.000711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929f768839754f09a333dd6c65d9ad94'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.007509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929f768839754f09a333dd6c65d9ad94'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.014913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929f768839754f09a333dd6c65d9ad94'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.015707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929f768839754f09a333dd6c65d9ad94'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.027891 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-3c34fe31-eea8-4c83-b3fc-5f81a1f17038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929f768839754f09a333dd6c65d9ad94'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.033575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1327/2691] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:25 2022] DELETE /identity/v3/users/929f768839754f09a333dd6c65d9ad94 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:26.302255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.303715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:26.316366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43db88-437a-4954-a5d0-80f225a64237 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.384082 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.384938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.385215 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.385484 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] PATH_INFO: `/v3/projects/7eda17f4ee4d4a409ba28b8438d6f295` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.387233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eda17f4ee4d4a409ba28b8438d6f295)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.389151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.439118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eda17f4ee4d4a409ba28b8438d6f295', 'request_id': 'req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.446140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eda17f4ee4d4a409ba28b8438d6f295', 'request_id': 'req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.452119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eda17f4ee4d4a409ba28b8438d6f295', 'request_id': 'req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.462612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] The token cache is being invalidate because project 7eda17f4ee4d4a409ba28b8438d6f295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:26.462893 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.463513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-e61dc06d-c25e-42f1-8a05-55e6a2427ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:26.465647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1365/2692] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:26 2022] DELETE /identity/v3/projects/7eda17f4ee4d4a409ba28b8438d6f295 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:26.471545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.471827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.472099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.490073 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:26.491258 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:26.548518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1328/2693] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:26.556844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.557124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.557396 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.577959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:26.579176 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:26.587063 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1366/2694] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:26.591806 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.601524 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d4d96-9a05-4045-b43f-05e6693b58e4 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.606835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.607661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.608122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.608507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.609378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:26.609838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.611578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.623395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1329/2695] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:26.627708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.637227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c538b3-93b5-4788-8a9c-00d0ba15c07d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.642124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.642762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.643036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.643304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.643974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.645909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.672080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1367/2696] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:26 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:26.676532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.686942 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8edb0b-7ac8-459c-b15f-bc58734885c0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.740709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.741374 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.741655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.741960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.742672 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.744605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.765069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1330/2697] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:26 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:26.769625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.779998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683afe5-dbef-456a-bb5d-f0260d948ef4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.784593 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.785241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.785520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.785840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.786557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.788192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.799795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1368/2698] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:26.803783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.814322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b1e8-8614-46e6-8f37-c69e0e434874 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.820401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b84c-2a8f-4dac-8bda-f837b71b2db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.821050 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b84c-2a8f-4dac-8bda-f837b71b2db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.821330 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b84c-2a8f-4dac-8bda-f837b71b2db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.821904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b84c-2a8f-4dac-8bda-f837b71b2db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.822632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b84c-2a8f-4dac-8bda-f837b71b2db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.824799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b84c-2a8f-4dac-8bda-f837b71b2db3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.840489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1331/2699] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:32:26.841718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:26.851510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619fb74-532e-457c-a0ab-ee3de575dae7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:26.856719 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:26.857592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.857892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.858170 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] PATH_INFO: `/v3/projects/a1d60e0d535340f59149bd14eda448c8/users/e70707b19f2e4cc5839a1da5587addde/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.874090 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d60e0d535340f59149bd14eda448c8, user_id=e70707b19f2e4cc5839a1da5587addde, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:26.876789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:26.889926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1369/2700] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:26 2022] PUT /identity/v3/projects/a1d60e0d535340f59149bd14eda448c8/users/e70707b19f2e4cc5839a1da5587addde/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:26.901101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:26.901586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:26.901707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:26.929489 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] MFA Rules not processed for user `e70707b19f2e4cc5839a1da5587addde`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:26.930773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:26.991768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1332/2701] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:26.996970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.056538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6304a60-7907-4dd0-ac90-6c12ad48661a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.061813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.062463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.062744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.063018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.063709 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.065629 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.090208 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1370/2702] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:26 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:27.094242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.104643 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b2700-c0e9-4cc8-a523-bf0774d694b1 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.158306 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.158974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.159253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.159527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.160219 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.162180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.182154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1333/2703] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:27 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:27.187134 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.197598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae4b20-565f-4727-b0f4-00e22d47e25e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.202293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.202943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.203218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.203490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.204212 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.205849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.216741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1371/2704] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:27.220868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.231578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72cc94-e2ec-4243-b229-45c1e30c672c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.236212 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81166bbe-4f6a-4fbb-b269-f98d2d1f2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.236854 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166bbe-4f6a-4fbb-b269-f98d2d1f2d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.237130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166bbe-4f6a-4fbb-b269-f98d2d1f2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.237404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81166bbe-4f6a-4fbb-b269-f98d2d1f2d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.238155 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81166bbe-4f6a-4fbb-b269-f98d2d1f2d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.239738 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81166bbe-4f6a-4fbb-b269-f98d2d1f2d2a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.250246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1334/2705] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:27.254431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.264528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51242-f228-41bc-bf34-ad9aea8bae45 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.269172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.270076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.270349 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.270630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] PATH_INFO: `/v3/projects/11720fc662b147f3a8bcfbb41d94bd7f/users/71fa2c118cf947108a6c36cffff26cb1/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.284915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11720fc662b147f3a8bcfbb41d94bd7f, user_id=71fa2c118cf947108a6c36cffff26cb1, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.287765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.300976 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1372/2706] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:27 2022] PUT /identity/v3/projects/11720fc662b147f3a8bcfbb41d94bd7f/users/71fa2c118cf947108a6c36cffff26cb1/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:27.312903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.313120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.313394 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.339272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] MFA Rules not processed for user `71fa2c118cf947108a6c36cffff26cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:27.340550 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:27.405721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1335/2707] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:27.410287 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.469681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f4f87-465f-4a36-b6d8-5573f0607629 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.474339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.475015 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.475289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.475557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.476247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.478235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.503980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1373/2708] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:27 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:27.508240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.519239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcd024-2d9a-4d64-80f9-a2ad7941f48d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.575588 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.576186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.576465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.576740 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.577464 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.579491 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.600299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1336/2709] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:27 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:27.606005 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.616828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b9b65-a9c5-40e5-bf3d-b5652ad8d999 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.622385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.622985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.623386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.623556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.625097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.626853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.641783 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1374/2710] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:32:27.644371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.656546 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cfb3c-0b9d-4aef-b6bd-987684da0e4c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.661962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.662852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.663305 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.663582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] PATH_INFO: `/v3/projects/78ccdd7c6c5646689b8bca3053bc65b8/users/61768b9af2f347678c35e8e7139c5aa1/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.680623 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ccdd7c6c5646689b8bca3053bc65b8, user_id=61768b9af2f347678c35e8e7139c5aa1, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.683498 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.698070 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1337/2711] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:27 2022] PUT /identity/v3/projects/78ccdd7c6c5646689b8bca3053bc65b8/users/61768b9af2f347678c35e8e7139c5aa1/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:27.705478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.718293 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5a019-cc58-4f87-82ab-2e334c19a2fa admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.782644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612f104-4fd1-4e41-bf54-e7fcfa5053d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.783306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612f104-4fd1-4e41-bf54-e7fcfa5053d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.783582 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612f104-4fd1-4e41-bf54-e7fcfa5053d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.783848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612f104-4fd1-4e41-bf54-e7fcfa5053d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.784572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612f104-4fd1-4e41-bf54-e7fcfa5053d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.786205 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612f104-4fd1-4e41-bf54-e7fcfa5053d0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.796164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1375/2712] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:27.800734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.813525 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496512-7757-44f4-85d4-254e1c538878 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:27.820910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:27.822737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.823252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.823753 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] PATH_INFO: `/v3/projects/78ccdd7c6c5646689b8bca3053bc65b8/users/61768b9af2f347678c35e8e7139c5aa1/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.829940 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ccdd7c6c5646689b8bca3053bc65b8, user_id=61768b9af2f347678c35e8e7139c5aa1, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:27.830351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:27.843946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1338/2713] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:27 2022] PUT /identity/v3/projects/78ccdd7c6c5646689b8bca3053bc65b8/users/61768b9af2f347678c35e8e7139c5aa1/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:27.854454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:27.855312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:27.855312 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:27.881326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] MFA Rules not processed for user `61768b9af2f347678c35e8e7139c5aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:27.882548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:27.962604 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1376/2714] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:27.971954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:27.973869 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:28.033562 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf100-7594-40ef-9bb7-c0fe7a952534 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:28.039192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:28.039846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:28.040121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:28.040390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:28.055342 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:28.056844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:28.066828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1339/2715] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:32:28.109232 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:28.110860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:28.123540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde785a-c8a7-4ec8-9bc6-aaaa3528c586 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:28.127553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf134b7d-2068-449b-807d-c1b2e9f3a874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:28.128241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134b7d-2068-449b-807d-c1b2e9f3a874 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:28.128567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134b7d-2068-449b-807d-c1b2e9f3a874 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:28.128970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf134b7d-2068-449b-807d-c1b2e9f3a874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:28.186198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134b7d-2068-449b-807d-c1b2e9f3a874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:28.187650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf134b7d-2068-449b-807d-c1b2e9f3a874 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:28.197036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1377/2716] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:30.650740 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:30.652191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:30.714674 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549757-c6b6-45b9-a04b-8ea1c99a9baa service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:30.721355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:30.722266 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.722552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.724711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] PATH_INFO: `/v3/users/048e7c4575d44d548b50254561c9a7dd` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.725975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048e7c4575d44d548b50254561c9a7dd)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:30.727901 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:30.772539 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048e7c4575d44d548b50254561c9a7dd'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:30.779707 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048e7c4575d44d548b50254561c9a7dd'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:30.786736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048e7c4575d44d548b50254561c9a7dd'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:30.787373 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048e7c4575d44d548b50254561c9a7dd'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:30.798881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048e7c4575d44d548b50254561c9a7dd'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:30.804712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1340/2717] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:30 2022] DELETE /identity/v3/users/048e7c4575d44d548b50254561c9a7dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:30.809124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.809625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.809786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.827301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:30.828457 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:30.883947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1378/2718] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:30.894150 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:30.895531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:30.951321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa563c-3d41-4e24-a864-3d65bbcd0e86 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:30.954925 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0635e3-7a26-4f05-b39c-83552f37d074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:30.955563 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0635e3-7a26-4f05-b39c-83552f37d074 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:30.955855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0635e3-7a26-4f05-b39c-83552f37d074 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:30.956125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0635e3-7a26-4f05-b39c-83552f37d074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:30.964723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0635e3-7a26-4f05-b39c-83552f37d074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:30.966716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0635e3-7a26-4f05-b39c-83552f37d074 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:30.975749 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1341/2719] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:31.072786 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.074316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.086399 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4c6e7-3c16-496d-a74b-b5ca87439ef5 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.091532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.092383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.092675 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.092923 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] PATH_INFO: `/v3/users/e70707b19f2e4cc5839a1da5587addde` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.094137 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70707b19f2e4cc5839a1da5587addde)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.096078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.154780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70707b19f2e4cc5839a1da5587addde'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.161474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70707b19f2e4cc5839a1da5587addde'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.170365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70707b19f2e4cc5839a1da5587addde'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.182198 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70707b19f2e4cc5839a1da5587addde'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.182848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70707b19f2e4cc5839a1da5587addde'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.189464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1379/2720] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:31 2022] DELETE /identity/v3/users/e70707b19f2e4cc5839a1da5587addde => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:31.194181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.194583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.194858 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.213220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:31.214455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.248456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.250021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.277933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1342/2721] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:31.286739 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.288124 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.320701 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6a81-0a32-4144-95b2-ce2e2355dac6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.326351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.327209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.327486 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.327756 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] PATH_INFO: `/v3/projects/54b2f9ea19a34a40adee92b3ba1ff1c3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.328933 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b2f9ea19a34a40adee92b3ba1ff1c3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.330907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.360614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbdd3e-9c84-4107-942b-3898dece381d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.364259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.364903 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.365178 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.365450 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.375609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.377029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b2f9ea19a34a40adee92b3ba1ff1c3', 'request_id': 'req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.377168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.384974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b2f9ea19a34a40adee92b3ba1ff1c3', 'request_id': 'req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.387950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1343/2722] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:32:31.393355 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b2f9ea19a34a40adee92b3ba1ff1c3', 'request_id': 'req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.404364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] The token cache is being invalidate because project 54b2f9ea19a34a40adee92b3ba1ff1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:31.404644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.405321 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.411809 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1380/2723] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:31 2022] DELETE /identity/v3/projects/54b2f9ea19a34a40adee92b3ba1ff1c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:31.416093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.426034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a90a93-7fbd-4c87-8c51-aa8f9fc80f00 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.482746 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.483697 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.483972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.484243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] PATH_INFO: `/v3/users/0f62bba2ca4f4caab6c6d2ad9afd0f83` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.485465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f62bba2ca4f4caab6c6d2ad9afd0f83)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.487462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.545521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f62bba2ca4f4caab6c6d2ad9afd0f83'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.552278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f62bba2ca4f4caab6c6d2ad9afd0f83'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.562388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f62bba2ca4f4caab6c6d2ad9afd0f83'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.563247 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f62bba2ca4f4caab6c6d2ad9afd0f83'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.579111 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f62bba2ca4f4caab6c6d2ad9afd0f83'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.585198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1344/2724] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:31 2022] DELETE /identity/v3/users/0f62bba2ca4f4caab6c6d2ad9afd0f83 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:31.665892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.667339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.687295 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e9576-1f4e-4da9-8d5a-0605dbfc11d6 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.766511 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.767401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.767686 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.768564 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] PATH_INFO: `/v3/projects/a1d60e0d535340f59149bd14eda448c8` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.770317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d60e0d535340f59149bd14eda448c8)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.773392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.827955 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d60e0d535340f59149bd14eda448c8', 'request_id': 'req-0b81c217-75a5-48a6-a0f0-092c42743605'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.835590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d60e0d535340f59149bd14eda448c8', 'request_id': 'req-0b81c217-75a5-48a6-a0f0-092c42743605'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.841119 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d60e0d535340f59149bd14eda448c8', 'request_id': 'req-0b81c217-75a5-48a6-a0f0-092c42743605'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.852103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] The token cache is being invalidate because project a1d60e0d535340f59149bd14eda448c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:31.852385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.853073 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.854687 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1381/2725] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:31 2022] DELETE /identity/v3/projects/a1d60e0d535340f59149bd14eda448c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:31.859264 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.860696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.873958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b2141-f85b-4b42-957c-dab838d407f6 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.894598 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:31.896040 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:31.943681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.944551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.944824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.945096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] PATH_INFO: `/v3/users/71fa2c118cf947108a6c36cffff26cb1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.946303 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fa2c118cf947108a6c36cffff26cb1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.948506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.962562 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c217-75a5-48a6-a0f0-092c42743605 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:31.968125 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:31.968975 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:31.969248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:31.969516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] PATH_INFO: `/v3/projects/c9d9ba076f4d449998e51b8af7679589` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:31.970713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d9ba076f4d449998e51b8af7679589)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:31.972637 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:31.993079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fa2c118cf947108a6c36cffff26cb1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:31.999915 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fa2c118cf947108a6c36cffff26cb1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.006653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fa2c118cf947108a6c36cffff26cb1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.007513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fa2c118cf947108a6c36cffff26cb1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.019207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-32b44704-ef18-4d9a-afed-cfed0b1b75d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fa2c118cf947108a6c36cffff26cb1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.020514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d9ba076f4d449998e51b8af7679589', 'request_id': 'req-f12214bc-37ca-40bb-b370-a0819e0f52d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.025323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1345/2726] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:31 2022] DELETE /identity/v3/users/71fa2c118cf947108a6c36cffff26cb1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:32.031919 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d9ba076f4d449998e51b8af7679589', 'request_id': 'req-f12214bc-37ca-40bb-b370-a0819e0f52d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.037448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d9ba076f4d449998e51b8af7679589', 'request_id': 'req-f12214bc-37ca-40bb-b370-a0819e0f52d7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.049472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] The token cache is being invalidate because project c9d9ba076f4d449998e51b8af7679589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:32.049782 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.050560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-f12214bc-37ca-40bb-b370-a0819e0f52d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.052265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1382/2727] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:31 2022] DELETE /identity/v3/projects/c9d9ba076f4d449998e51b8af7679589 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:32.059467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.059758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.060034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.078591 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:32.079933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.147949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1346/2728] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:32.156631 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.156950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.157231 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.176722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:32.178052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.191662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1383/2729] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:32.192896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.202743 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9ca01-7e7a-490b-a9f0-ac9382626e74 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.207618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.208280 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.208558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.208836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.209581 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:32.209920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.211572 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.223717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1347/2730] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:32.228097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.237953 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f0ba3-c205-46ae-9003-ff2888ff2d3a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.242612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.243265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.243542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.244233 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.244489 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.246877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.276189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1384/2731] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:32.277475 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.288010 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0e546-8f05-45bf-9933-7d3b376c95e2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.314154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.315865 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.347040 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.347719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.347997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.348273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.349118 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.351090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.374037 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1348/2732] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:32.375176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.384991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4852-2b67-458b-a784-f5edb2540a40 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.390847 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.391923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.392308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.392603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.393410 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.394820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656a649-d3e7-4e79-ad98-ff7371d8a9f4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.395069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.399640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.400500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.400827 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.401132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] PATH_INFO: `/v3/projects/11720fc662b147f3a8bcfbb41d94bd7f` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.402360 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=11720fc662b147f3a8bcfbb41d94bd7f)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.404860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.405830 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1349/2733] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:32:32.410076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.420402 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f7f8f-613b-4b8b-b234-efb189acd2ca admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.425226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.425999 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.426366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.426700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.427493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.429161 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.440689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1350/2734] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:32:32.444886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.454133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11720fc662b147f3a8bcfbb41d94bd7f', 'request_id': 'req-acbd8c77-cb6a-49f9-9635-329dc453e5ee'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.455846 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e5592-feb7-44c5-b2d1-c2c805676059 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.461522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11720fc662b147f3a8bcfbb41d94bd7f', 'request_id': 'req-acbd8c77-cb6a-49f9-9635-329dc453e5ee'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.467654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11720fc662b147f3a8bcfbb41d94bd7f', 'request_id': 'req-acbd8c77-cb6a-49f9-9635-329dc453e5ee'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.478470 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] The token cache is being invalidate because project 11720fc662b147f3a8bcfbb41d94bd7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:32.478794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.479516 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.481327 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1385/2735] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:32 2022] DELETE /identity/v3/projects/11720fc662b147f3a8bcfbb41d94bd7f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:32.485039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.486373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.509890 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9efa-8418-4bb0-bee2-48ae34407350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.510773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9efa-8418-4bb0-bee2-48ae34407350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.511045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9efa-8418-4bb0-bee2-48ae34407350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.511315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9efa-8418-4bb0-bee2-48ae34407350 admin admin] PATH_INFO: `/v3/projects/8ecc6dfd98c84b76a0b70d31d0b6ce5e/users/e38b3553e9a0471c8e0f6df894df29e4/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.526210 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de9efa-8418-4bb0-bee2-48ae34407350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecc6dfd98c84b76a0b70d31d0b6ce5e, user_id=e38b3553e9a0471c8e0f6df894df29e4, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.529569 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de9efa-8418-4bb0-bee2-48ae34407350 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.542494 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1351/2736] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:32 2022] PUT /identity/v3/projects/8ecc6dfd98c84b76a0b70d31d0b6ce5e/users/e38b3553e9a0471c8e0f6df894df29e4/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:32.551839 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd8c77-cb6a-49f9-9635-329dc453e5ee admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.553726 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.554072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.554335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.581667 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] MFA Rules not processed for user `e38b3553e9a0471c8e0f6df894df29e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:32.582912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.608004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.608889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.609162 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.609431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] PATH_INFO: `/v3/users/61768b9af2f347678c35e8e7139c5aa1` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.610668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61768b9af2f347678c35e8e7139c5aa1)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.612600 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.650162 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1352/2737] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:32.660724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61768b9af2f347678c35e8e7139c5aa1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.661006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.662365 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.667275 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61768b9af2f347678c35e8e7139c5aa1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.674535 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61768b9af2f347678c35e8e7139c5aa1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.686750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61768b9af2f347678c35e8e7139c5aa1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.687469 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61768b9af2f347678c35e8e7139c5aa1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:32.693201 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1386/2738] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:32 2022] DELETE /identity/v3/users/61768b9af2f347678c35e8e7139c5aa1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:32.717853 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5ab06-6013-4af7-9e96-07c48ca662e5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:32.768488 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:32.769143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:32.769438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:32.769704 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:32.771556 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:32.830513 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:32.832045 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0fb7e-f882-4738-9db3-03e5a79997ff service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:32.842144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1353/2739] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:32:32.958139 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:32.959739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:33.029351 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e3d2-04e7-4ad8-94ab-b5658d7c08a3 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.033877 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.034726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.035004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.035273 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] PATH_INFO: `/v3/projects/78ccdd7c6c5646689b8bca3053bc65b8` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.036441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ccdd7c6c5646689b8bca3053bc65b8)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.038497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.088290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ccdd7c6c5646689b8bca3053bc65b8', 'request_id': 'req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:33.095762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ccdd7c6c5646689b8bca3053bc65b8', 'request_id': 'req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:33.102997 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ccdd7c6c5646689b8bca3053bc65b8', 'request_id': 'req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:33.115639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] The token cache is being invalidate because project 78ccdd7c6c5646689b8bca3053bc65b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:33.115927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:33.116587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-bbb3c659-5e0e-4ed2-92bc-873c31e35b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:33.118307 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1387/2740] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:32 2022] DELETE /identity/v3/projects/78ccdd7c6c5646689b8bca3053bc65b8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:33.125594 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.126113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.126240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.147344 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:33.148637 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:33.209104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1354/2741] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:33.217503 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.217998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.218303 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.238189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:33.239379 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:33.248299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1388/2742] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:33.252406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.261953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a45c57-84fe-4ea8-8a80-68a789adbcfe None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.266582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.267230 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.267510 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.267785 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.268503 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:33.268809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.270467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.281640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1355/2743] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:33.285861 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.295313 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53218c83-b197-46cd-9cab-0e0942375669 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.299915 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.300557 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.300835 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.301107 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.301825 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.303742 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.328299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1389/2744] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:33 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:33.332290 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.342012 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad65ad-b5fe-45e6-aed3-3a288bf39b4b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.395573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.396234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.396512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.396782 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.397465 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.399416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.422439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1356/2745] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:33 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:33.426924 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.437651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e2d1b-dd0b-4baf-a1e7-09750b4ce648 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.442339 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.443025 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.443329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.443601 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.444326 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.446004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.456413 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1390/2746] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:33.460143 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.470668 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e104a34-65f3-4eac-8a3b-e466a83b5e83 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.475289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c121ff-6347-4bd2-80a1-634b3a73b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.475961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c121ff-6347-4bd2-80a1-634b3a73b61d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.476239 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c121ff-6347-4bd2-80a1-634b3a73b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.476509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c121ff-6347-4bd2-80a1-634b3a73b61d admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.477224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c121ff-6347-4bd2-80a1-634b3a73b61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.478872 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c121ff-6347-4bd2-80a1-634b3a73b61d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.490322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1357/2747] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:33.494235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.503802 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560fd23-40a4-45a7-acb8-0972974b59b9 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.508370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.509252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.509526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.509830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] PATH_INFO: `/v3/projects/d5e69c78098d4435a5cb06eef0c8c8ed/users/0d9fcfc68b724b4b8e26f70a25ec706c/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.524891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e69c78098d4435a5cb06eef0c8c8ed, user_id=0d9fcfc68b724b4b8e26f70a25ec706c, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.527688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.541982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1391/2748] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:33 2022] PUT /identity/v3/projects/d5e69c78098d4435a5cb06eef0c8c8ed/users/0d9fcfc68b724b4b8e26f70a25ec706c/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:33.548006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a93def-7b2d-4db6-8507-293b58ae532f None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.548291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a93def-7b2d-4db6-8507-293b58ae532f None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.548565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a93def-7b2d-4db6-8507-293b58ae532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.565622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-10a93def-7b2d-4db6-8507-293b58ae532f None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:33.566910 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-10a93def-7b2d-4db6-8507-293b58ae532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:33.623422 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1358/2749] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:33.633003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:33.634746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:33.690910 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51408-35b1-4fea-aa16-14f4c05ef169 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:33.694563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:33.695199 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:33.695476 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:33.695747 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:33.705128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:33.706594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:33.716350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1392/2750] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:32:34.301451 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.301982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.302098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.329479 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] MFA Rules not processed for user `0d9fcfc68b724b4b8e26f70a25ec706c`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:34.330742 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:34.410627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1359/2751] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:34.417892 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.431256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ab60-29c6-498d-96a9-9caf0c056b6c service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.435798 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.436444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.436718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.436986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.437683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.439625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.464774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1393/2752] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:34 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:34.469234 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.479803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5cce-8425-437c-b02a-e97be1185880 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.536293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.537080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.537359 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.537629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.538392 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.540461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.558877 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1360/2753] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:34 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:34.562856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.573244 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6fb3-ad8e-4a6a-a855-fac689211dce admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.578255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.578901 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.579175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.579446 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.580165 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.581788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.592828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1394/2754] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:34.596815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.606681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078308d-ebc6-4b8f-8ada-274c64c13fea admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.611166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.612053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.612334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.612596 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] PATH_INFO: `/v3/projects/8086dec1ad24438b8aa732408214e8b8/users/2980146093cd42d6806fd6b34c53d583/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.626474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8086dec1ad24438b8aa732408214e8b8, user_id=2980146093cd42d6806fd6b34c53d583, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.629133 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.642060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1361/2755] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:34 2022] PUT /identity/v3/projects/8086dec1ad24438b8aa732408214e8b8/users/2980146093cd42d6806fd6b34c53d583/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:34.645930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.656717 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeed6aa-5e75-4730-8d63-e2ce856c0070 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.710697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45a59c-4335-4d6e-a1fd-30c58e5569a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.711341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45a59c-4335-4d6e-a1fd-30c58e5569a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.711621 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45a59c-4335-4d6e-a1fd-30c58e5569a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.711894 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45a59c-4335-4d6e-a1fd-30c58e5569a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.712620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45a59c-4335-4d6e-a1fd-30c58e5569a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.714248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45a59c-4335-4d6e-a1fd-30c58e5569a9 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.727897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1395/2756] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:34.729117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:34.741530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564253c7-93ba-4176-8b5f-8b61dd38144b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:34.746768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:34.747646 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:34.747929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:34.748201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] PATH_INFO: `/v3/projects/8086dec1ad24438b8aa732408214e8b8/users/2980146093cd42d6806fd6b34c53d583/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:34.750201 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8086dec1ad24438b8aa732408214e8b8, user_id=2980146093cd42d6806fd6b34c53d583, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:34.752868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:34.764076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1362/2757] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:34 2022] PUT /identity/v3/projects/8086dec1ad24438b8aa732408214e8b8/users/2980146093cd42d6806fd6b34c53d583/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:35.340036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:35.340373 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:35.340653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:35.367210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] MFA Rules not processed for user `2980146093cd42d6806fd6b34c53d583`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:35.368389 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:35.447816 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1396/2758] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:35.459677 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:35.461386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:35.520229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c018fc9-3534-4ba7-8ad6-9407cd663868 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:35.523826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:35.524462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:35.524737 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:35.525005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:35.579679 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:35.581121 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:35.589788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1363/2759] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:37.967583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:37.976909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44495490-8ba4-4e5a-90b4-0d9ad5b1ce1e None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:37.980583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08354-7eff-4690-9cfc-a4a9fd077f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:37.981213 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08354-7eff-4690-9cfc-a4a9fd077f14 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:37.981501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08354-7eff-4690-9cfc-a4a9fd077f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:37.981789 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08354-7eff-4690-9cfc-a4a9fd077f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:37.990512 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef08354-7eff-4690-9cfc-a4a9fd077f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:37.991941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef08354-7eff-4690-9cfc-a4a9fd077f14 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:38.001712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1397/2760] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:51.025173 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.026649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.095054 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa81e26-4281-4934-82ec-049c70fef7c0 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.099767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.100629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.100902 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.101168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] PATH_INFO: `/v3/users/e38b3553e9a0471c8e0f6df894df29e4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.102366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38b3553e9a0471c8e0f6df894df29e4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:51.104328 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:51.149065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38b3553e9a0471c8e0f6df894df29e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.156108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38b3553e9a0471c8e0f6df894df29e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.163816 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38b3553e9a0471c8e0f6df894df29e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.164431 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38b3553e9a0471c8e0f6df894df29e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.176724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38b3553e9a0471c8e0f6df894df29e4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.182947 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1364/2761] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:51 2022] DELETE /identity/v3/users/e38b3553e9a0471c8e0f6df894df29e4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:51.188430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.189283 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.189586 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.209650 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:51.211238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.276858 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1398/2762] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:51.288188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.290105 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.349019 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a791b-ab68-4e22-8c3a-3119e114d406 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.353360 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94f118-54f1-4c37-80c1-938b56e4e22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.354076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94f118-54f1-4c37-80c1-938b56e4e22e service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.354357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94f118-54f1-4c37-80c1-938b56e4e22e service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.354632 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94f118-54f1-4c37-80c1-938b56e4e22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.363717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94f118-54f1-4c37-80c1-938b56e4e22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:51.365297 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94f118-54f1-4c37-80c1-938b56e4e22e service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:51.374577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1365/2763] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:51.633224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.634743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.647018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20398bf6-9123-4395-9e5d-dd1979465346 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.651615 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.652461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.652739 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.653009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] PATH_INFO: `/v3/projects/8ecc6dfd98c84b76a0b70d31d0b6ce5e` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.654235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecc6dfd98c84b76a0b70d31d0b6ce5e)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:51.656794 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:51.702981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecc6dfd98c84b76a0b70d31d0b6ce5e', 'request_id': 'req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.709435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecc6dfd98c84b76a0b70d31d0b6ce5e', 'request_id': 'req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.714758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecc6dfd98c84b76a0b70d31d0b6ce5e', 'request_id': 'req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.726449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] The token cache is being invalidate because project 8ecc6dfd98c84b76a0b70d31d0b6ce5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:51.726734 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.727370 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-78aeb6d6-1055-4bad-bcaf-9bf2d2b62482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:51.728907 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1399/2764] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:51 2022] DELETE /identity/v3/projects/8ecc6dfd98c84b76a0b70d31d0b6ce5e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:51.734405 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.734717 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.734991 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.753856 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:51.755085 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.811519 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1366/2765] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:51.819319 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.819605 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.819887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.837574 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:51.838788 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:51.847259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1400/2766] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:51.851293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.861241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eff954-faae-441b-a0fe-64979c0d656d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.866082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.866721 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.866993 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.867263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.867970 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:51.868269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:51.869974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:51.881971 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1367/2767] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:51.885972 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.895505 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5d98c-13c4-4797-8342-3ba8a50cb9c0 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.900129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.900772 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.901044 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.901310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:51.902003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:51.903911 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:51.928624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1401/2768] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:51.932725 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:51.943167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e49ab-3064-472b-aaa5-22915a0fa50a admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:51.997649 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:51.998335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:51.998614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:51.998888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:52.000080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:52.002032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:52.021904 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1368/2769] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:51 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:52.025927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:52.036385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7b0f4-a15f-407d-b528-6d7d7169e031 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:52.040948 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:52.041618 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:52.041897 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:52.042243 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:52.042971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:52.044567 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:52.054852 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1402/2770] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:52.058841 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:52.069081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2d2ff-42df-438a-af9a-0f4ee99e7353 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:52.074157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbe0d2-42cc-4435-963e-868a5f95afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:52.074809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe0d2-42cc-4435-963e-868a5f95afbf admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:52.075087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe0d2-42cc-4435-963e-868a5f95afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:52.075357 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe0d2-42cc-4435-963e-868a5f95afbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:52.076072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe0d2-42cc-4435-963e-868a5f95afbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:52.078331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe0d2-42cc-4435-963e-868a5f95afbf admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:52.087953 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1369/2771] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:52.091823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:52.101491 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c76f-889f-430c-ae92-5cfcd718d2a8 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:52.106054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:52.106909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:52.107183 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:52.107450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] PATH_INFO: `/v3/projects/56b80ff77ba34997843a869bd2707989/users/a2a9871c81d649a897166091dd1d4af8/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:52.121974 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b80ff77ba34997843a869bd2707989, user_id=a2a9871c81d649a897166091dd1d4af8, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:52.125450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:52.137525 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1403/2772] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:52 2022] PUT /identity/v3/projects/56b80ff77ba34997843a869bd2707989/users/a2a9871c81d649a897166091dd1d4af8/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:52.142621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:52.142907 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:52.143180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:52.160126 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:52.161304 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:52.217469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1370/2773] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:52.227771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:52.229490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:52.285093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fad87-59ef-4496-9b58-0e7b3e96a9b7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:52.288677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:52.289306 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:52.289580 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:52.289890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:52.298568 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:52.299987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:52.309762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1404/2774] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:55.773332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:55.775796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:55.790262 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595ebc-2564-434e-b43a-620959ce57fe None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:55.797552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:55.798574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:55.799314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:55.800396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] PATH_INFO: `/v3/users/0d9fcfc68b724b4b8e26f70a25ec706c` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:55.801145 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9fcfc68b724b4b8e26f70a25ec706c)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:55.803555 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:55.860822 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9fcfc68b724b4b8e26f70a25ec706c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:55.868179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9fcfc68b724b4b8e26f70a25ec706c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:55.876855 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9fcfc68b724b4b8e26f70a25ec706c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:55.878433 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9fcfc68b724b4b8e26f70a25ec706c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:55.893281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9fcfc68b724b4b8e26f70a25ec706c'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:55.908941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1371/2775] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:55 2022] DELETE /identity/v3/users/0d9fcfc68b724b4b8e26f70a25ec706c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:56.478378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:56.490204 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b610e-897c-472d-9389-9e936ddcc3b1 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:56.565328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:56.566383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:56.566713 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:56.566996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] PATH_INFO: `/v3/projects/d5e69c78098d4435a5cb06eef0c8c8ed` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:56.568253 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e69c78098d4435a5cb06eef0c8c8ed)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:56.571536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:56.639749 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e69c78098d4435a5cb06eef0c8c8ed', 'request_id': 'req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.665982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e69c78098d4435a5cb06eef0c8c8ed', 'request_id': 'req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.673941 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e69c78098d4435a5cb06eef0c8c8ed', 'request_id': 'req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.690361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] The token cache is being invalidate because project d5e69c78098d4435a5cb06eef0c8c8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:56.690969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.691917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.693585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1405/2776] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:56 2022] DELETE /identity/v3/projects/d5e69c78098d4435a5cb06eef0c8c8ed => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:56.697980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:56.699873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:56.732808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec7fc-9be6-433c-9369-c33fed8e6f6e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:56.808565 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:56.810676 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:56.811323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:56.812310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] PATH_INFO: `/v3/users/2980146093cd42d6806fd6b34c53d583` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:56.814011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2980146093cd42d6806fd6b34c53d583)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:56.816362 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:56.881692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2980146093cd42d6806fd6b34c53d583'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.889423 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2980146093cd42d6806fd6b34c53d583'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.901776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2980146093cd42d6806fd6b34c53d583'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.902532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2980146093cd42d6806fd6b34c53d583'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.917627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1481f9e4-5828-4785-8063-ccfe6887e664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2980146093cd42d6806fd6b34c53d583'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:56.929826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1372/2777] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:56 2022] DELETE /identity/v3/users/2980146093cd42d6806fd6b34c53d583 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:57.132128 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.134613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:57.152248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670b2c0-7ea1-4efd-bdb1-d040f801be1e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.220745 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.221624 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.221964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.222235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] PATH_INFO: `/v3/projects/8086dec1ad24438b8aa732408214e8b8` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.223477 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8086dec1ad24438b8aa732408214e8b8)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.225775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.284341 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8086dec1ad24438b8aa732408214e8b8', 'request_id': 'req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:57.295003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8086dec1ad24438b8aa732408214e8b8', 'request_id': 'req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:57.303238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8086dec1ad24438b8aa732408214e8b8', 'request_id': 'req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:57.319590 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] The token cache is being invalidate because project 8086dec1ad24438b8aa732408214e8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:57.319887 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:57.320616 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1e1285b6-ce58-40f8-ae82-1a4c0bdd00f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:57.322947 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1406/2778] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:57 2022] DELETE /identity/v3/projects/8086dec1ad24438b8aa732408214e8b8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:57.328253 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b52833-e878-4e04-8e2f-2fa30a36397a None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.328635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b52833-e878-4e04-8e2f-2fa30a36397a None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.329011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b52833-e878-4e04-8e2f-2fa30a36397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.494370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-25b52833-e878-4e04-8e2f-2fa30a36397a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:57.495153 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-25b52833-e878-4e04-8e2f-2fa30a36397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:57.522337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.522831 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.522958 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.550647 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] MFA Rules not processed for user `a2a9871c81d649a897166091dd1d4af8`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:57.552075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:57.556976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1373/2779] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:57.565653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.566223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.566223 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.587744 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:57.589301 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:57.598950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1374/2780] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:57.602696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.611958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b84ac-13c1-449c-8d7e-a4f5480351a9 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.617027 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.617908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.618276 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.618827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.619706 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:57.620072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.621823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.623270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1407/2781] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:57.627443 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.629644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:57.637913 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1375/2782] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 16 17:32:57.642269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.647655 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420e87f-4c31-4d79-a1b6-910a883a7eae None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.652333 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.652991 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.653666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.654126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.655104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181af04-4634-49b3-9b38-53283c1b0be3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.656129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.658150 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.660773 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.661906 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.662168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.663069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.663709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.665966 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.688356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1408/2783] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:57.692890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.698110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1376/2784] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:32:57.701784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.762625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2317f-0e6e-44b8-b06f-b0718d55f7eb admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.767618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7fc7-18df-4e77-8392-9a8c7e3f7cc2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.768109 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.768774 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.769049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.769509 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.770173 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.772103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.772599 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.773351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.773701 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.774069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.774823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.776832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.794828 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1409/2785] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:57.801069 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1377/2786] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:57 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:57.801224 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.802277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.811439 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383424c-0e85-4ebd-9a9c-0032daaa06f5 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.812960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fa6f-46be-4f44-bf5b-f6286d14c0c5 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.816729 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.817538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.817918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.818107 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.818311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.818734 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.819007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.819209 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.819346 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.819972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.821240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.821844 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.833397 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1410/2787] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:32:57.837350 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.839175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1378/2788] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:57.843461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.849046 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b16dab-e009-4a9e-a2a2-c09b989e1240 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.861940 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.862830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.863105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.863380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] PATH_INFO: `/v3/projects/e9f3a23fcb6e40c7a86962473a518ae3/users/fb76ddd4d50d4309ab4d3ef8442d46b1/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.866220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc0f6-112e-4877-92d1-3c6cc419c62d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.877780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.878585 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.878810 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.879278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.880520 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.882548 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.884248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f3a23fcb6e40c7a86962473a518ae3, user_id=fb76ddd4d50d4309ab4d3ef8442d46b1, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.887625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.899090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1379/2789] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:32:57.903057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.909029 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1411/2790] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:57 2022] PUT /identity/v3/projects/e9f3a23fcb6e40c7a86962473a518ae3/users/fb76ddd4d50d4309ab4d3ef8442d46b1/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:57.910037 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:57.914815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d055e1-b9c3-4866-8349-2a5e8441313f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.981979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980b886-7093-45fe-9689-7f366ce522f3 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:57.987550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.988214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.988495 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.988768 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:57.989493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:57.991144 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:57.994895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bb963-d95f-45c1-abde-37b36e8f5702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:57.995776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb963-d95f-45c1-abde-37b36e8f5702 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:57.996055 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb963-d95f-45c1-abde-37b36e8f5702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:57.996326 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb963-d95f-45c1-abde-37b36e8f5702 admin admin] PATH_INFO: `/v3/projects/77ae35cb641a4d0da0a061998e4f5f1d/users/37a4a9d4fee146ca98ca029778ea7456/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.001329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1412/2791] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:32:58.005266 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:58.010534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bb963-d95f-45c1-abde-37b36e8f5702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ae35cb641a4d0da0a061998e4f5f1d, user_id=37a4a9d4fee146ca98ca029778ea7456, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:58.013287 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bb963-d95f-45c1-abde-37b36e8f5702 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:58.015591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099809f-cfe6-4573-a11c-c6c939a564c0 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:58.020770 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:58.021627 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:58.021971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:58.022257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] PATH_INFO: `/v3/projects/e9f3a23fcb6e40c7a86962473a518ae3/users/fb76ddd4d50d4309ab4d3ef8442d46b1/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.024276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f3a23fcb6e40c7a86962473a518ae3, user_id=fb76ddd4d50d4309ab4d3ef8442d46b1, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:58.027034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:58.028348 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1380/2792] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:57 2022] PUT /identity/v3/projects/77ae35cb641a4d0da0a061998e4f5f1d/users/37a4a9d4fee146ca98ca029778ea7456/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:32:58.038547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1413/2793] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:32:58 2022] PUT /identity/v3/projects/e9f3a23fcb6e40c7a86962473a518ae3/users/fb76ddd4d50d4309ab4d3ef8442d46b1/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:58.039951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:58.040238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:58.040512 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.069087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] MFA Rules not processed for user `37a4a9d4fee146ca98ca029778ea7456`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:58.070366 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:58.141719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1381/2794] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:58.152928 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:58.154793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:58.235681 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac1572-69df-4023-99a1-afeca432ed8e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:58.239352 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85608ec3-8136-47d2-aed5-e1bb77edc355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:58.240018 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608ec3-8136-47d2-aed5-e1bb77edc355 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:58.240277 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608ec3-8136-47d2-aed5-e1bb77edc355 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:58.240550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608ec3-8136-47d2-aed5-e1bb77edc355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.250066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608ec3-8136-47d2-aed5-e1bb77edc355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:58.252016 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608ec3-8136-47d2-aed5-e1bb77edc355 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:58.261428 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1414/2795] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:58.285267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:58.382087 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90342a42-807e-43f6-8a6d-298046e54632 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:58.389222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:58.391207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:58.391669 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:58.392171 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] PATH_INFO: `/v3/users/37a4a9d4fee146ca98ca029778ea7456` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.394974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a4a9d4fee146ca98ca029778ea7456)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:58.401797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:58.464769 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a4a9d4fee146ca98ca029778ea7456'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:58.479053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a4a9d4fee146ca98ca029778ea7456'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:58.487638 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a4a9d4fee146ca98ca029778ea7456'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:58.488337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a4a9d4fee146ca98ca029778ea7456'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:58.503583 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a4a9d4fee146ca98ca029778ea7456'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:58.513401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1382/2796] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:32:58 2022] DELETE /identity/v3/users/37a4a9d4fee146ca98ca029778ea7456 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:58.515800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:58.516178 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:58.516542 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.535041 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:58.538521 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:58.601558 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1415/2797] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:58.611867 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:58.613686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:58.679978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73d03a-a352-4047-b715-13afed9c1ed0 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:58.685851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c13ab9-8863-4b4e-a78b-e18a10712a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:58.686780 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c13ab9-8863-4b4e-a78b-e18a10712a2d service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:58.686945 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c13ab9-8863-4b4e-a78b-e18a10712a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:58.687209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c13ab9-8863-4b4e-a78b-e18a10712a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:58.700216 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c13ab9-8863-4b4e-a78b-e18a10712a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:58.702490 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c13ab9-8863-4b4e-a78b-e18a10712a2d service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:58.728477 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1383/2798] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:32:59.304101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:59.305679 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:59.329848 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9793c-e5f4-4925-8693-adeddd80e856 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:59.343045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:59.345126 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:59.346080 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:59.348200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] PATH_INFO: `/v3/projects/77ae35cb641a4d0da0a061998e4f5f1d` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:59.351106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ae35cb641a4d0da0a061998e4f5f1d)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:59.355332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:59.466156 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ae35cb641a4d0da0a061998e4f5f1d', 'request_id': 'req-7c9f30f7-13da-4124-867c-25fc92ed0d72'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:59.481883 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ae35cb641a4d0da0a061998e4f5f1d', 'request_id': 'req-7c9f30f7-13da-4124-867c-25fc92ed0d72'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:59.497639 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ae35cb641a4d0da0a061998e4f5f1d', 'request_id': 'req-7c9f30f7-13da-4124-867c-25fc92ed0d72'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:59.517038 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] The token cache is being invalidate because project 77ae35cb641a4d0da0a061998e4f5f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:32:59.517767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:59.518694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-7c9f30f7-13da-4124-867c-25fc92ed0d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:32:59.521222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1416/2799] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:32:59 2022] DELETE /identity/v3/projects/77ae35cb641a4d0da0a061998e4f5f1d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:32:59.526188 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:59.526783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:59.526783 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:59.556995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:59.558263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:59.678370 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1384/2800] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:32:59.679085 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:59.679668 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:59.679951 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:59.730411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:32:59.732188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:32:59.756545 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:59.757166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1417/2801] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:32:59.771868 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3805-84f2-40fd-9172-1393bded33fb None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:59.784412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:59.785108 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:59.785529 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:59.785664 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:59.786383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:32:59.786689 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:59.788386 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:59.834459 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:59.836692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1385/2802] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:32:59.850103 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057a53a-b9d9-4d2a-9e5e-0fc3903213e3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:32:59.862256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:32:59.863189 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:32:59.863767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:32:59.864257 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:32:59.865400 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:32:59.868981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:32:59.962919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:32:59.964186 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1418/2803] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:32:59 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:32:59.974795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39ec4-59f4-4314-b64c-d3eaa0df30a3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:00.117427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:00.118620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:00.119152 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:00.119634 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:00.120610 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:00.123039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:00.160031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1386/2804] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:32:59 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:33:00.164451 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:00.184423 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6650ee-762f-4e55-96b5-be5eb115b2b4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:00.193501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:00.194164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:00.194547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:00.194833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:00.195657 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:00.198161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:00.220987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1419/2805] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:33:00.225060 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:00.237625 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa8c78-9099-4f8c-aa5e-6dd021f5a31c admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:00.245574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97daa6fd-64dc-484e-a448-95204e90ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:00.247648 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daa6fd-64dc-484e-a448-95204e90ac1d admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:00.248181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daa6fd-64dc-484e-a448-95204e90ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:00.248709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97daa6fd-64dc-484e-a448-95204e90ac1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:00.248709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daa6fd-64dc-484e-a448-95204e90ac1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:00.257835 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97daa6fd-64dc-484e-a448-95204e90ac1d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:00.280895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1387/2806] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:33:00.284651 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:00.302092 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086147d-5e24-4fa1-b466-38a14f70315b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:00.310318 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:00.312969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:00.313706 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:00.314501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] PATH_INFO: `/v3/projects/f7f76cd7683c421887c275012f85b7e7/users/538772abcea644dba3d954861abee7a4/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:00.335805 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f76cd7683c421887c275012f85b7e7, user_id=538772abcea644dba3d954861abee7a4, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:00.338771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:00.355028 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1420/2807] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:33:00 2022] PUT /identity/v3/projects/f7f76cd7683c421887c275012f85b7e7/users/538772abcea644dba3d954861abee7a4/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:33:00.366799 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269a53-1a0b-4e02-92b1-4e0599b637e2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:00.367157 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269a53-1a0b-4e02-92b1-4e0599b637e2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:00.367355 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269a53-1a0b-4e02-92b1-4e0599b637e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:00.400177 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a6269a53-1a0b-4e02-92b1-4e0599b637e2 None None] MFA Rules not processed for user `538772abcea644dba3d954861abee7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:00.401383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a6269a53-1a0b-4e02-92b1-4e0599b637e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:00.482986 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1388/2808] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:00.495587 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:00.498766 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:00.611263 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9027a-beb9-4a94-a693-78894a816408 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:00.615548 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:00.616241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:00.616577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:00.616854 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:00.627188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:00.628692 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:00.640143 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1421/2809] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:03.222462 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:03.223675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:03.224192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:03.235240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:03.236965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:03.278796 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] MFA Rules not processed for user `fb76ddd4d50d4309ab4d3ef8442d46b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:03.280078 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:03.363075 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda834b-0d77-4037-8438-a77486cba136 service glance] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:03.366886 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:03.367819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:03.368101 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:03.368378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:03.370252 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:03.376842 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1389/2810] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:03.392093 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:03.394698 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:03.455332 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:03.456913 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7243920-4fef-492b-8275-bd204c48a2f2 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:03.473409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1422/2811] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:03.515640 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c694d5d-f87b-4d7b-90bb-5c8dd83d8077 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:03.522602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:03.523352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:03.523720 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:03.524064 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:03.526736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:03.597895 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:03.599506 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:03.609088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1390/2812] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:33:28.282712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:28.283279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:28.283279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:28.300566 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] MFA Rules not processed for user `a2a9871c81d649a897166091dd1d4af8`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:28.301761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:28.308648 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1423/2813] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:28.347192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:28.348617 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:28.360181 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413a935-0f08-4271-9834-e14bf20b6ae8 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:28.363786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:28.364414 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:28.364688 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:28.364954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:28.366670 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:28.379941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:28.381293 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:28.392350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1391/2814] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:28.663001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:28.664381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:28.727592 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b1c8-2bb4-45b3-8052-17352af9ced3 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:28.731194 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:28.731840 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:28.732118 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:28.732392 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:28.734188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:28.744292 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:28.745733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:28.754377 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1424/2815] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:29.192106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:29.193538 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:29.200124 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:29.201538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:29.212288 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92a2f9-5a2f-4719-a129-fb537849ed4c service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:29.215803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:29.216438 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:29.216721 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:29.216983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:29.218718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:29.232419 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:29.233926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:29.245493 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1425/2816] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:33:29.262580 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2e05-9f85-4763-908c-232c21a6a498 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:29.267597 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:29.268278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:29.268552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:29.268824 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:29.270618 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:29.282380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:29.283975 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:29.293851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1392/2817] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:31.063087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:31.073708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276560a-0029-4429-a6f9-4af1a47a6f35 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:31.077595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:31.078356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:31.078622 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:31.078889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:31.081475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:31.093024 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:31.095021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710342-99a6-4f3c-ad07-b250f9261aa7 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:31.104597 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1426/2818] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:32.781310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:32.840603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745da41-f06a-42f1-9871-002a031a73d8 service placement] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:32.845166 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:32.846099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:32.846322 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:32.846586 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] PATH_INFO: `/v3/users/538772abcea644dba3d954861abee7a4` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:32.847750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538772abcea644dba3d954861abee7a4)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:32.849652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:32.897448 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538772abcea644dba3d954861abee7a4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:32.905663 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538772abcea644dba3d954861abee7a4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:32.915696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538772abcea644dba3d954861abee7a4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:32.916388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538772abcea644dba3d954861abee7a4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:32.929224 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538772abcea644dba3d954861abee7a4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:32.939225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1393/2819] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:33:32 2022] DELETE /identity/v3/users/538772abcea644dba3d954861abee7a4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:33:32.940850 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:32.941310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:32.941410 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:32.958863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:32.960096 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:33.019556 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1427/2820] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:33.030110 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.031522 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:33.093129 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52438584-7864-4fb3-b723-01cabd771b42 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.097007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80af3-fee7-4ede-a157-4345febc9ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.097716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80af3-fee7-4ede-a157-4345febc9ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.098139 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80af3-fee7-4ede-a157-4345febc9ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.098440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80af3-fee7-4ede-a157-4345febc9ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.108001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80af3-fee7-4ede-a157-4345febc9ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.109443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80af3-fee7-4ede-a157-4345febc9ac4 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.119628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1394/2821] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:33.534054 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.535758 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:33.547660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a9cb1-d5bd-4f06-b6f1-3a4427ed8f6d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.552918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.553806 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.554104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.554380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] PATH_INFO: `/v3/projects/f7f76cd7683c421887c275012f85b7e7` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.555596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f76cd7683c421887c275012f85b7e7)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.557528 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.603053 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f76cd7683c421887c275012f85b7e7', 'request_id': 'req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:33.611057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f76cd7683c421887c275012f85b7e7', 'request_id': 'req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:33.616442 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f76cd7683c421887c275012f85b7e7', 'request_id': 'req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:33.627056 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] The token cache is being invalidate because project f7f76cd7683c421887c275012f85b7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:33:33.627365 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:33.627971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-43f916bc-dbe9-4f3c-9d17-bd8fe4db234a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:33.629520 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1428/2822] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:33:33 2022] DELETE /identity/v3/projects/f7f76cd7683c421887c275012f85b7e7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:33:33.634302 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.634660 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.634935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.652408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:33.653577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:33.712074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1395/2823] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:33.719608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.720473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.720748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.738192 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:33.739362 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:33.747105 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1429/2824] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:33.751142 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.760626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42f6b-f1ab-4bbd-9ae2-000073438209 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.765487 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.766206 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.766480 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.767288 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.768011 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:33:33.768310 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.769935 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.781620 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1396/2825] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:33:33.786383 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.795795 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9359be-b4c7-448b-989f-c965a59711ac None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.800620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.801640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.802035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.802310 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.803012 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.804986 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.839481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1430/2826] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:33:33 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:33:33.840659 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.851191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e430-0dd5-45cf-898c-a0a4fa3c6719 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.906056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.906750 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.907030 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.907926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.908616 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.910570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.928896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1397/2827] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:33:33 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:33:33.932883 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.943026 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35fc37-5fa5-4960-b24c-1e29ea5e0663 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.947801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.948449 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.948724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.948989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.949957 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.951572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.962544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1431/2828] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:33:33.966504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:33.977996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3053e-5e7b-468b-8182-51cdab69c623 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:33.982626 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb524612-4e2e-4c04-87e0-d1f05ef34fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:33.983340 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb524612-4e2e-4c04-87e0-d1f05ef34fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:33.983694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb524612-4e2e-4c04-87e0-d1f05ef34fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:33.983983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb524612-4e2e-4c04-87e0-d1f05ef34fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:33.984692 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb524612-4e2e-4c04-87e0-d1f05ef34fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:33.986377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb524612-4e2e-4c04-87e0-d1f05ef34fd4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:33.996553 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1398/2829] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:33:34.000823 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:34.010583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663e63e-2d58-4646-a02a-f774bf211684 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:34.015299 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:34.016247 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:34.017269 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:34.017599 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] PATH_INFO: `/v3/projects/b2599a43f1924ad9a9e864180023a89b/users/9b59f3067532446aa6ad7bf613307742/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:34.031565 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2599a43f1924ad9a9e864180023a89b, user_id=9b59f3067532446aa6ad7bf613307742, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:34.034908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:34.046779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1432/2830] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:33:33 2022] PUT /identity/v3/projects/b2599a43f1924ad9a9e864180023a89b/users/9b59f3067532446aa6ad7bf613307742/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:33:34.057417 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:34.057724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:34.058029 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:34.084675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] MFA Rules not processed for user `9b59f3067532446aa6ad7bf613307742`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:34.086294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:34.147504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1399/2831] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:33:34.158256 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:34.159916 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:34.215799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf5eff-dd9c-48db-a392-3fc75fa90dff admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:34.219464 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:34.220131 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:34.220409 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:34.220680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:34.228799 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:34.230285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:34.238821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1433/2832] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:42.587482 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:42.588950 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:42.661767 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb11419-49d8-407f-9829-4fc8ac9fa1a5 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:42.667198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:42.667886 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:42.668167 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:42.668439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:42.670227 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:42.682289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:42.683874 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a10ff0-dbed-4a3d-b692-40ccd3a60a75 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:42.694558 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1400/2833] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:43.851971 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:43.914167 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2910-609f-4df8-b501-5aa0c1a7ae0f service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:43.918492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:43.919345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:43.919619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:43.919888 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] PATH_INFO: `/v3/users/9b59f3067532446aa6ad7bf613307742` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:43.921043 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b59f3067532446aa6ad7bf613307742)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:43.923583 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:43.966501 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b59f3067532446aa6ad7bf613307742'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:43.973644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b59f3067532446aa6ad7bf613307742'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:43.980778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b59f3067532446aa6ad7bf613307742'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:43.992646 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b59f3067532446aa6ad7bf613307742'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:43.993264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b59f3067532446aa6ad7bf613307742'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:43.998931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1434/2834] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:33:43 2022] DELETE /identity/v3/users/9b59f3067532446aa6ad7bf613307742 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:33:44.003461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:44.003965 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:44.004113 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:44.021388 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:33:44.022652 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:44.080205 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1401/2835] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:33:44.089862 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:44.091264 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:44.146694 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2c442-5a5d-469f-b22c-c770749bad24 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:44.150346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:44.150987 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:44.151267 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:44.151541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:44.160860 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:44.162308 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:44.171723 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1435/2836] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:44.472615 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:44.474117 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:44.491013 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841a584-bd95-4a2d-8684-60bd8afb1b7c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:44.495619 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:44.496474 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:44.496731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:44.497007 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] PATH_INFO: `/v3/projects/b2599a43f1924ad9a9e864180023a89b` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:44.498228 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2599a43f1924ad9a9e864180023a89b)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:44.500209 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:44.546043 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2599a43f1924ad9a9e864180023a89b', 'request_id': 'req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:44.553243 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2599a43f1924ad9a9e864180023a89b', 'request_id': 'req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:44.558582 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2599a43f1924ad9a9e864180023a89b', 'request_id': 'req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:44.569543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] The token cache is being invalidate because project b2599a43f1924ad9a9e864180023a89b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:33:44.569851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:44.570723 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:33:44.572265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1402/2837] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:33:44 2022] DELETE /identity/v3/projects/b2599a43f1924ad9a9e864180023a89b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:33:45.813960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:45.822838 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9a5b0-89d3-40d5-8ce2-c62d9b06ab2f service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:45.870081 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:45.870724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:45.871001 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:45.871271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:45.873033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:45.934061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:45.935463 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ff6ab-2ca6-4efc-975b-cdb028779a46 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:45.944748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1436/2838] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:33:47.497881 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:33:47.499351 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:47.576020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426f8a1-370f-4c3b-beb6-5e3aa633f1cf admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:33:47.583028 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:33:47.583920 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:33:47.584068 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:33:47.584544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:33:47.587032 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:33:47.600412 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:33:47.602091 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:33:47.614833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1403/2839] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:33:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:35:46.292031 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8411-c829-4879-b021-23288880121b None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:35:46.292917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8411-c829-4879-b021-23288880121b None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:35:46.293136 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a8411-c829-4879-b021-23288880121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:35:46.320726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9d1a8411-c829-4879-b021-23288880121b None None] MFA Rules not processed for user `a2a9871c81d649a897166091dd1d4af8`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:35:46.322855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9d1a8411-c829-4879-b021-23288880121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:35:46.395822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1437/2840] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:35:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:35:46.717888 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:35:46.719397 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:35:46.731004 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8ed7-75a8-4fe2-a784-334d3d94cd68 service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:35:46.734624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:35:46.735272 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:35:46.735551 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:35:46.735820 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:35:46.737523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:35:46.747575 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:35:46.748997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:35:46.757407 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1404/2841] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:35:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:04.133812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8411-c829-4879-b021-23288880121b None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:04.135259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9d1a8411-c829-4879-b021-23288880121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:04.147654 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a8411-c829-4879-b021-23288880121b None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:04.151630 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:04.152289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:04.152570 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:04.152863 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:04.154691 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:04.241596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:04.243113 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:04.263386 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1438/2842] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:07.159425 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:07.160837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:07.180765 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e917eb-1d3f-46a1-9e8c-6fb620724c10 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:07.185515 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:07.186294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.186552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.186851 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] PATH_INFO: `/v3/users/189966fbd18f4152b6b54ba5492034e0` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.203584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=189966fbd18f4152b6b54ba5492034e0)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:07.205627 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:07.256736 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189966fbd18f4152b6b54ba5492034e0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.264229 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189966fbd18f4152b6b54ba5492034e0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.274537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189966fbd18f4152b6b54ba5492034e0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.275088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189966fbd18f4152b6b54ba5492034e0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.287314 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-41360c7c-aaf2-4eb3-83e4-c233459ad4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189966fbd18f4152b6b54ba5492034e0'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.293179 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1405/2843] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:07 2022] DELETE /identity/v3/users/189966fbd18f4152b6b54ba5492034e0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:07.476337 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:07.488602 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec79f-5f53-4f17-a310-9d05355bad60 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:07.545411 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:07.546226 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.546500 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.546767 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] PATH_INFO: `/v3/projects/59a45b25fa9e4a4bb9e144de365602bc` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.548014 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a45b25fa9e4a4bb9e144de365602bc)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:07.549970 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:07.596611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a45b25fa9e4a4bb9e144de365602bc', 'request_id': 'req-496d6de3-d0dc-483c-a5be-38cf66b5c55a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.604508 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a45b25fa9e4a4bb9e144de365602bc', 'request_id': 'req-496d6de3-d0dc-483c-a5be-38cf66b5c55a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.609870 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a45b25fa9e4a4bb9e144de365602bc', 'request_id': 'req-496d6de3-d0dc-483c-a5be-38cf66b5c55a'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.621258 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] The token cache is being invalidate because project 59a45b25fa9e4a4bb9e144de365602bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:07.621538 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.622197 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-496d6de3-d0dc-483c-a5be-38cf66b5c55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:07.623830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1439/2844] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:07 2022] DELETE /identity/v3/projects/59a45b25fa9e4a4bb9e144de365602bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:07.629574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.629880 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.630158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.685476 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:07.686733 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:07.747622 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1406/2845] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:36:07.755497 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.755785 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.756061 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.781265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:07.785678 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:07.796466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1440/2846] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:07.800730 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:07.811236 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c51a2-5b26-46f3-b8a1-632c5d3d74fb None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:07.816497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:07.817164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.817435 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.817731 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.819082 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79956) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:36:07.819507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:07.821347 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:07.833578 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1407/2847] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:36:07.837980 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:07.847356 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759554e-ca08-4df8-94d8-bda4cc5f87b2 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:07.852595 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:07.853270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.853544 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.853844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] PATH_INFO: `/v3/projects` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.854526 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:07.856454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:07.893238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1441/2848] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:07 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:07.897387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:07.907495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff534-9b4b-47f1-82a5-bc3acf58be2b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:07.962644 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:07.963174 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:07.963469 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:07.963741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] PATH_INFO: `/v3/users` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:07.964432 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:07.966395 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:07.990570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1408/2849] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:07 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:07.991821 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:08.002485 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cbdc9-64ef-41d6-8c34-953836957355 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:08.007163 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:08.007819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:08.008097 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:08.008367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:08.009093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:08.010743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:08.020603 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1442/2850] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:08.025207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:08.034957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde9f59-cde1-4e45-a7d4-a6297b6c3f91 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:08.040120 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee505fb6-61f4-40a2-97a5-86379bc80186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:08.040774 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505fb6-61f4-40a2-97a5-86379bc80186 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:08.041052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505fb6-61f4-40a2-97a5-86379bc80186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:08.041321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee505fb6-61f4-40a2-97a5-86379bc80186 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:08.042079 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee505fb6-61f4-40a2-97a5-86379bc80186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:08.043694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee505fb6-61f4-40a2-97a5-86379bc80186 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:08.054755 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1409/2851] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:08.059171 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:08.069530 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9eea86-2e22-4df5-b95e-15847fa5906b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:08.074255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:08.075149 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:08.075429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:08.075703 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] PATH_INFO: `/v3/projects/b1572ff0742d4570b90efda5e2258fe1/users/6257366e275b4f0ea8108dc660bc88ce/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:08.090932 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1572ff0742d4570b90efda5e2258fe1, user_id=6257366e275b4f0ea8108dc660bc88ce, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:08.093722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:08.107289 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1443/2852] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:08 2022] PUT /identity/v3/projects/b1572ff0742d4570b90efda5e2258fe1/users/6257366e275b4f0ea8108dc660bc88ce/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:08.118083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:08.118368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:08.118645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:08.144361 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] MFA Rules not processed for user `6257366e275b4f0ea8108dc660bc88ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:08.145560 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:08.215278 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1410/2853] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:08.226623 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:08.228346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:08.295818 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac65d-5e47-464f-b34f-e42be67eac8b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:08.299448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:08.300089 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:08.300367 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:08.300644 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:08.309454 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:08.310966 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:08.320364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1444/2854] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:15.964203 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:15.965609 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:16.044119 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22023b7e-0952-46b9-a061-ed9c63b5c54d None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:16.049031 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:16.049675 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:16.049981 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:16.050252 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:16.051996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:16.063318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:16.064889 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2a89-98e7-4c7c-85aa-62b5d1e974d0 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:16.075323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1411/2855] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:16.594279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:16.656291 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e256ac5-2807-481e-97ae-9dd53db7306b service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:16.660891 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:16.662348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:16.662640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:16.662912 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] PATH_INFO: `/v3/users/6257366e275b4f0ea8108dc660bc88ce` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:16.664142 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6257366e275b4f0ea8108dc660bc88ce)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:16.666132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:16.711964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6257366e275b4f0ea8108dc660bc88ce'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:16.718435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6257366e275b4f0ea8108dc660bc88ce'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:16.726452 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6257366e275b4f0ea8108dc660bc88ce'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:16.737837 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6257366e275b4f0ea8108dc660bc88ce'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:16.738532 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6257366e275b4f0ea8108dc660bc88ce'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:16.744908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1445/2856] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:16 2022] DELETE /identity/v3/users/6257366e275b4f0ea8108dc660bc88ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:16.749573 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:16.749961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:16.750231 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:16.767308 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:16.768527 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:16.825564 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1412/2857] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:16.835369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:16.836784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:16.904522 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac996496-c46e-4288-a75e-78f51702bd0a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:16.908132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373714e-6b95-4959-8277-b9e8e0e730c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:16.908791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373714e-6b95-4959-8277-b9e8e0e730c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:16.909066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373714e-6b95-4959-8277-b9e8e0e730c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:16.909331 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373714e-6b95-4959-8277-b9e8e0e730c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:16.920034 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373714e-6b95-4959-8277-b9e8e0e730c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:16.921475 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373714e-6b95-4959-8277-b9e8e0e730c2 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:16.932927 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1446/2858] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:17.210136 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.212015 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:17.224946 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadbb44-2cfd-487c-a619-e3841eb291ae None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.230196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.231104 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.231387 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.231657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] PATH_INFO: `/v3/projects/b1572ff0742d4570b90efda5e2258fe1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.233023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1572ff0742d4570b90efda5e2258fe1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.235065 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.294168 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1572ff0742d4570b90efda5e2258fe1', 'request_id': 'req-4638f5bd-ca32-432c-8c90-c5b338311819'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:17.301331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1572ff0742d4570b90efda5e2258fe1', 'request_id': 'req-4638f5bd-ca32-432c-8c90-c5b338311819'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:17.306673 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1572ff0742d4570b90efda5e2258fe1', 'request_id': 'req-4638f5bd-ca32-432c-8c90-c5b338311819'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:17.318049 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] The token cache is being invalidate because project b1572ff0742d4570b90efda5e2258fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:17.318332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:17.318973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-4638f5bd-ca32-432c-8c90-c5b338311819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:17.320507 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1413/2859] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:17 2022] DELETE /identity/v3/projects/b1572ff0742d4570b90efda5e2258fe1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:36:17.325513 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.325830 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.326133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.344210 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:17.345395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:17.402348 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1447/2860] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:17.410192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.410509 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.410826 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.428758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:17.429972 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:17.437681 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1414/2861] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:17.442083 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.452381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921867e-84a4-4b96-bbb7-71bc227ce40d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.456925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.457572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.457925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.458693 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.459412 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:36:17.459718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.461364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.472577 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1448/2862] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:36:17.476776 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.486265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606bfdf-832c-41eb-9fde-763945d0bb1c None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.491101 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.491768 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.492053 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.492317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.493023 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.495009 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.521281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1415/2863] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:17.525620 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.535425 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70949ac3-2007-4aba-9da0-0ed07fd48b61 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.589007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.589661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.589985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.590259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.590936 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.592917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.612069 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1449/2864] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/users => generated 282 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:17.616629 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.626486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc005b-f499-41d4-8b11-76cead0a6abd admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.631587 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.632213 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.632485 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.632748 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.633455 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.635099 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.646198 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1416/2865] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:17.650222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.660106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31724485-5c76-48db-87a6-b3a67f6fa3d4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.664781 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f9c3e-b3b8-4b87-8d38-2d1920a1894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.665431 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9c3e-b3b8-4b87-8d38-2d1920a1894c admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.665712 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9c3e-b3b8-4b87-8d38-2d1920a1894c admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.666013 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f9c3e-b3b8-4b87-8d38-2d1920a1894c admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.666846 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f9c3e-b3b8-4b87-8d38-2d1920a1894c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.668466 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f9c3e-b3b8-4b87-8d38-2d1920a1894c admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.680133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1450/2866] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:17.684158 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.694651 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c43274-f880-433b-8a2b-b196770781bd admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.699327 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.700185 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.700458 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.700728 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] PATH_INFO: `/v3/projects/492dd0415a454ad2bb7d995d89326510/users/4847ecf6ed064eb6ade9c1d96a413080/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.714537 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492dd0415a454ad2bb7d995d89326510, user_id=4847ecf6ed064eb6ade9c1d96a413080, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.717123 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.730248 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1417/2867] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:17 2022] PUT /identity/v3/projects/492dd0415a454ad2bb7d995d89326510/users/4847ecf6ed064eb6ade9c1d96a413080/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:17.742188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.742478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.742753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.768700 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] MFA Rules not processed for user `4847ecf6ed064eb6ade9c1d96a413080`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:17.769960 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:17.829985 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1451/2868] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:17.834719 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.894823 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85e2e-c0e8-4025-ad1e-769748bac3e8 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.899532 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.900175 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.900449 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:17.900718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:17.901443 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:17.903554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:17.927752 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1418/2869] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:17.931803 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:17.943255 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21678f6-4ff8-480e-95b7-b25bd4ef8122 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:17.998954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:17.999537 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:17.999822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.000093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.000784 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.002763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.022708 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1452/2870] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:17 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:36:18.026712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:18.036554 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f362a9-2598-41de-812c-5edaf21e5868 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:18.041499 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:18.042172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.042447 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.042713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.043424 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.045016 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.055628 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1419/2871] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:18.059791 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:18.070844 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d0f3e-2a3b-46f4-a07b-929d5f2cbe22 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:18.075753 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:18.076677 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.076969 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.077245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] PATH_INFO: `/v3/projects/0a9a3b10c18740e4b14b0fcb8d5df7cd/users/170106446a45411f9f953f539d097755/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.092122 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9a3b10c18740e4b14b0fcb8d5df7cd, user_id=170106446a45411f9f953f539d097755, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.095091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.108506 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1453/2872] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:18 2022] PUT /identity/v3/projects/0a9a3b10c18740e4b14b0fcb8d5df7cd/users/170106446a45411f9f953f539d097755/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:18.112577 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:18.124052 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380b382-89cc-4f26-95d3-467cb0c2041b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:18.178700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc42a7-388c-4f4a-8150-b4050d07705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:18.179401 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc42a7-388c-4f4a-8150-b4050d07705b admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.179696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc42a7-388c-4f4a-8150-b4050d07705b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.180041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc42a7-388c-4f4a-8150-b4050d07705b admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.180843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc42a7-388c-4f4a-8150-b4050d07705b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.182492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc42a7-388c-4f4a-8150-b4050d07705b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.192061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1420/2873] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:18.196478 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:18.206536 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba1ae-1e87-4bbf-a980-56663ee442bc admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:18.211249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:18.212188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.212472 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.212744 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] PATH_INFO: `/v3/projects/0a9a3b10c18740e4b14b0fcb8d5df7cd/users/170106446a45411f9f953f539d097755/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.214760 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9a3b10c18740e4b14b0fcb8d5df7cd, user_id=170106446a45411f9f953f539d097755, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.217440 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.228059 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1454/2874] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:18 2022] PUT /identity/v3/projects/0a9a3b10c18740e4b14b0fcb8d5df7cd/users/170106446a45411f9f953f539d097755/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:18.238254 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.238827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.238827 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.265952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] MFA Rules not processed for user `170106446a45411f9f953f539d097755`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:18.267135 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:18.334249 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1421/2875] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:18.346036 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:18.347771 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:18.408900 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5a201-d7fc-48b3-8783-257f7f23342a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:18.413251 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:18.413950 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.414748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.414748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.423722 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.425151 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.435250 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1455/2876] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:18.505786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:18.515270 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df270eb4-1e06-4ee1-a0b1-85a0253e2222 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:18.518924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b311d-1ff9-477f-a180-c7d5d0840932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:18.519500 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b311d-1ff9-477f-a180-c7d5d0840932 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:18.519777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b311d-1ff9-477f-a180-c7d5d0840932 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:18.520047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b311d-1ff9-477f-a180-c7d5d0840932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:18.574406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b311d-1ff9-477f-a180-c7d5d0840932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:18.575793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b311d-1ff9-477f-a180-c7d5d0840932 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:18.585088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1422/2877] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:28.886424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:28.952093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc3b5c-7c01-410e-a9a7-e4868d320f33 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:28.957546 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:28.958441 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:28.958750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:28.959021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] PATH_INFO: `/v3/users/4847ecf6ed064eb6ade9c1d96a413080` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:28.960222 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4847ecf6ed064eb6ade9c1d96a413080)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:28.962762 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:29.009320 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4847ecf6ed064eb6ade9c1d96a413080'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.015720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4847ecf6ed064eb6ade9c1d96a413080'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.023889 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4847ecf6ed064eb6ade9c1d96a413080'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.036074 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4847ecf6ed064eb6ade9c1d96a413080'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.036741 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4847ecf6ed064eb6ade9c1d96a413080'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.043364 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1456/2878] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:28 2022] DELETE /identity/v3/users/4847ecf6ed064eb6ade9c1d96a413080 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:29.047899 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:29.048377 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:29.048504 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:29.067311 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:29.069071 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:29.134380 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1423/2879] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:29.144091 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:29.145461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:29.201290 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954597-562e-49a5-9aeb-9c0d18f8f25e admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:29.204908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:29.205547 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:29.205849 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:29.206120 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:29.215510 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:29.216939 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:29.226078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1457/2880] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:29.496486 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:29.497917 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:29.509605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db38c4c-701b-4a6f-9a0e-66fb56614cc8 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:29.514269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:29.515147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:29.515427 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:29.515694 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] PATH_INFO: `/v3/projects/492dd0415a454ad2bb7d995d89326510` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:29.516978 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] RBAC: Authorizing `identity:delete_project(project_id=492dd0415a454ad2bb7d995d89326510)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:29.518941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:29.577461 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492dd0415a454ad2bb7d995d89326510', 'request_id': 'req-bd9e10aa-fe54-4b97-870f-90826070573b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.584291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492dd0415a454ad2bb7d995d89326510', 'request_id': 'req-bd9e10aa-fe54-4b97-870f-90826070573b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.590318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492dd0415a454ad2bb7d995d89326510', 'request_id': 'req-bd9e10aa-fe54-4b97-870f-90826070573b'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.600980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] The token cache is being invalidate because project 492dd0415a454ad2bb7d995d89326510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:29.601285 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.601932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.603478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1424/2881] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:29 2022] DELETE /identity/v3/projects/492dd0415a454ad2bb7d995d89326510 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:29.607385 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:29.616636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11eb0c-aa41-42b9-bea9-8e5911e9d8f4 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:29.671588 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:29.672456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:29.672732 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:29.673003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] PATH_INFO: `/v3/users/170106446a45411f9f953f539d097755` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:29.674240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170106446a45411f9f953f539d097755)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:29.676220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:29.721108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170106446a45411f9f953f539d097755'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.727607 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170106446a45411f9f953f539d097755'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.734550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170106446a45411f9f953f539d097755'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.746829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170106446a45411f9f953f539d097755'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.748129 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-97e8fd5c-5e8c-48b2-a4c2-4bba69590354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170106446a45411f9f953f539d097755'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:29.754761 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1458/2882] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:29 2022] DELETE /identity/v3/users/170106446a45411f9f953f539d097755 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:30.021528 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.023084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:30.039696 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e10aa-fe54-4b97-870f-90826070573b admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.093657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.094552 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.094828 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.095098 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] PATH_INFO: `/v3/projects/0a9a3b10c18740e4b14b0fcb8d5df7cd` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.096269 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9a3b10c18740e4b14b0fcb8d5df7cd)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.098263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.143083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9a3b10c18740e4b14b0fcb8d5df7cd', 'request_id': 'req-1125bd32-4d51-4555-be66-cfac5c076ed4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:30.149579 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9a3b10c18740e4b14b0fcb8d5df7cd', 'request_id': 'req-1125bd32-4d51-4555-be66-cfac5c076ed4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:30.154777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9a3b10c18740e4b14b0fcb8d5df7cd', 'request_id': 'req-1125bd32-4d51-4555-be66-cfac5c076ed4'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:30.165786 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] The token cache is being invalidate because project 0a9a3b10c18740e4b14b0fcb8d5df7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:30.166074 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:30.166713 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-1125bd32-4d51-4555-be66-cfac5c076ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:30.168238 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1425/2883] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:30 2022] DELETE /identity/v3/projects/0a9a3b10c18740e4b14b0fcb8d5df7cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:30.175076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.175559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.175683 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.195716 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:30.197408 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:30.253032 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1459/2884] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:30.261331 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.261613 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.261930 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.280140 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:30.281323 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:30.289176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1426/2885] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:30.293918 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.303552 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aab61-82fd-44a7-bea7-d39790d7266a None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.308822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.309474 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.309765 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.310051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.310775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:36:30.311078 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.312715 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.324132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1460/2886] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:36:30.328317 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.338039 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e1b6-ef42-4d21-9146-616e141d4f80 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.342653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.343296 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.343570 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.343843 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.344518 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.346467 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.371208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1427/2887] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:30 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:30.375241 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.385561 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25831a42-26f2-44dc-99da-a0aa6b2c5b0f admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.445115 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.445890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.446175 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.446450 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.447154 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.454141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.470195 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1461/2888] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:30 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:30.474544 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.487194 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d185-bde9-4649-a3b5-a7a07cf4e2be admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.493144 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.493926 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.494204 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.494472 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.495191 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.496787 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.509125 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1428/2889] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:30.512954 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.522836 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2178901-075a-4645-9b16-86b195df327a admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.528653 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462e066-fda7-4a82-9ce2-44a5af015c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.529317 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462e066-fda7-4a82-9ce2-44a5af015c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.529594 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462e066-fda7-4a82-9ce2-44a5af015c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.529909 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462e066-fda7-4a82-9ce2-44a5af015c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.530636 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462e066-fda7-4a82-9ce2-44a5af015c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.532245 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462e066-fda7-4a82-9ce2-44a5af015c91 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.542763 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1462/2890] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 16 17:36:30.546914 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.556961 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b662764-76ab-4774-8376-a2f2bba60a73 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.561495 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.562385 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.562657 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.562924 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] PATH_INFO: `/v3/projects/bdc544077b6f4b318cc2e5f03ecab988/users/8db41fb2d2344384ac251da50ce74ce9/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.578220 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc544077b6f4b318cc2e5f03ecab988, user_id=8db41fb2d2344384ac251da50ce74ce9, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.580908 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.594115 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1429/2891] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:30 2022] PUT /identity/v3/projects/bdc544077b6f4b318cc2e5f03ecab988/users/8db41fb2d2344384ac251da50ce74ce9/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:30.607641 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.607930 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.608238 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.634560 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] MFA Rules not processed for user `8db41fb2d2344384ac251da50ce74ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:30.635697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:30.699182 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1463/2892] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:30.711406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:30.713063 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:30.773368 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048893e-d18a-421e-8c10-85ec6a86f6e2 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:30.780154 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a7da9-ef33-4dd2-9e82-be5021aaff11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e3e792f55154143932d62ac460022b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:30.780809 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7da9-ef33-4dd2-9e82-be5021aaff11 service glance] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:30.781061 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7da9-ef33-4dd2-9e82-be5021aaff11 service glance] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:30.781324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a7da9-ef33-4dd2-9e82-be5021aaff11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:30.799457 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7da9-ef33-4dd2-9e82-be5021aaff11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:30.800937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a7da9-ef33-4dd2-9e82-be5021aaff11 service glance] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:30.810789 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1430/2893] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:46.279235 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:46.341067 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4310dce-e786-425a-be1a-ab2c600867a9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:46.346401 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:46.347268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:46.347550 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:46.347822 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] PATH_INFO: `/v3/users/8db41fb2d2344384ac251da50ce74ce9` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:46.348996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db41fb2d2344384ac251da50ce74ce9)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:46.350989 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:46.402857 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db41fb2d2344384ac251da50ce74ce9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:46.413649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db41fb2d2344384ac251da50ce74ce9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:46.418437 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db41fb2d2344384ac251da50ce74ce9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:46.429925 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db41fb2d2344384ac251da50ce74ce9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:46.430559 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db41fb2d2344384ac251da50ce74ce9'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:46.436270 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1464/2894] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:46 2022] DELETE /identity/v3/users/8db41fb2d2344384ac251da50ce74ce9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:46.440724 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:46.441282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:46.441282 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:46.459132 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:46.460318 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:46.527838 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1431/2895] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:46.538140 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:46.540328 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:46.605430 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93810726-64a6-4dec-ac78-4a80dacdc8f4 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:46.609608 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb5afb-5635-4aa6-b6ca-3efbbc19e380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:46.610286 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb5afb-5635-4aa6-b6ca-3efbbc19e380 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:46.610563 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb5afb-5635-4aa6-b6ca-3efbbc19e380 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:46.610832 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb5afb-5635-4aa6-b6ca-3efbbc19e380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:46.619779 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb5afb-5635-4aa6-b6ca-3efbbc19e380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:46.621217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb5afb-5635-4aa6-b6ca-3efbbc19e380 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:46.631104 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1465/2896] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:46.908803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:46.910244 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:46.939200 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7408-06be-4eb6-a905-36f0c11aecee None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:46.945814 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:46.946709 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:46.946979 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:46.947241 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] PATH_INFO: `/v3/projects/bdc544077b6f4b318cc2e5f03ecab988` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:46.948566 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc544077b6f4b318cc2e5f03ecab988)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:46.950584 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.006404 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc544077b6f4b318cc2e5f03ecab988', 'request_id': 'req-156f40b1-399b-4329-8731-65cc845d1b3f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:47.015352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc544077b6f4b318cc2e5f03ecab988', 'request_id': 'req-156f40b1-399b-4329-8731-65cc845d1b3f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:47.021711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc544077b6f4b318cc2e5f03ecab988', 'request_id': 'req-156f40b1-399b-4329-8731-65cc845d1b3f'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:47.034534 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] The token cache is being invalidate because project bdc544077b6f4b318cc2e5f03ecab988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79956) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:47.034784 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:47.035383 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-156f40b1-399b-4329-8731-65cc845d1b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:47.036951 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1432/2897] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:46 2022] DELETE /identity/v3/projects/bdc544077b6f4b318cc2e5f03ecab988 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:47.042064 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.042345 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.042613 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.064725 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:47.066141 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:47.128217 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1466/2898] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:36:47.136034 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.136321 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.136621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.155718 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:47.156900 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:47.164949 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1433/2899] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 16 17:36:47.169282 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.178829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82491a8-103c-4a43-94f2-3edb4647e476 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.183433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.184057 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.184338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.184635 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.185329 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79955) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 16 17:36:47.185666 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.187311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.199435 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1467/2900] 10.222.0.70 () {58 vars in 1152 bytes} [Mon May 16 17:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 16 17:36:47.204263 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.214076 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4684b6f-f241-454e-bdd3-bdc95972db4b None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.219933 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.220655 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.220934 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.221208 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.221995 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.223912 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.248439 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1434/2901] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:47.252660 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.262585 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7040e-00b3-4eb4-aecb-a6f2e4744b4b admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.318369 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.319033 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.319259 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.319572 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.320315 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.322415 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.342133 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1468/2902] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:47.346973 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.357211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860759b-ea7d-4bba-85cf-38affdc0c35f admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.361653 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.362338 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.362614 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.362885 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.363605 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.365207 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.375358 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1435/2903] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:47.379813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.390161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bcf49-efe4-4838-aa0f-3eb2d6f58be7 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.394819 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c968d-57a9-4e4f-af8e-a58237b15e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.395473 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c968d-57a9-4e4f-af8e-a58237b15e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.395750 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c968d-57a9-4e4f-af8e-a58237b15e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.396022 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c968d-57a9-4e4f-af8e-a58237b15e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.396743 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c968d-57a9-4e4f-af8e-a58237b15e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.398531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c968d-57a9-4e4f-af8e-a58237b15e48 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.409632 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1469/2904] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:47.413976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.424196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031cec6-1052-4f56-b677-30a39b0a3022 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.428803 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.429700 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.430006 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.430274 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] PATH_INFO: `/v3/projects/7fb034f11b2940a88c04cdde1bc1e0eb/users/6ed13b3c4a274ce6a47bf5237cef753a/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.445341 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb034f11b2940a88c04cdde1bc1e0eb, user_id=6ed13b3c4a274ce6a47bf5237cef753a, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.448267 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.463137 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1436/2905] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:47 2022] PUT /identity/v3/projects/7fb034f11b2940a88c04cdde1bc1e0eb/users/6ed13b3c4a274ce6a47bf5237cef753a/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:47.474488 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.474775 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.475051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.501298 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] MFA Rules not processed for user `6ed13b3c4a274ce6a47bf5237cef753a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:47.502533 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:47.565246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1470/2906] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:47.570186 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.642352 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be534d5f-6d6f-4af5-b0c5-f880f4f7c1ce admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.649246 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.650419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.650836 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.651242 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.652334 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.655603 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.691378 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1437/2907] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:47.695876 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.708017 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad721-acdb-4d70-92ed-8af518ed0a31 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.764052 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.764724 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.765002 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.765276 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.765994 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.767942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.788480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1471/2908] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 16 17:36:47.792612 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.804299 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e2b9c-b537-4792-9d8c-19cf1309b401 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.809094 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.809808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.810072 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.810350 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.811077 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.812708 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.824083 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1438/2909] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:47.828867 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.839049 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37594b50-e409-4d2a-ac7e-edcc1d98ae78 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.846812 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1f9bd-4819-49f3-afd1-fdfc6be79094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.847555 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1f9bd-4819-49f3-afd1-fdfc6be79094 admin admin] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.847853 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1f9bd-4819-49f3-afd1-fdfc6be79094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.848169 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1f9bd-4819-49f3-afd1-fdfc6be79094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.849008 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1f9bd-4819-49f3-afd1-fdfc6be79094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.850906 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1f9bd-4819-49f3-afd1-fdfc6be79094 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.862746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1472/2910] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:47.867954 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:47.878662 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5957-27c3-4d2e-89ee-d011c178cdfa admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:47.883493 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:47.884712 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.885081 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.885391 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] PATH_INFO: `/v3/projects/7892b9ca51044121ba73469fe9e03841/users/860c5b2a4e194f23ad3d80916d25734a/roles/e88b00d27c2f432c9dd8cefff2ee1371` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.902635 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7892b9ca51044121ba73469fe9e03841, user_id=860c5b2a4e194f23ad3d80916d25734a, role_id=e88b00d27c2f432c9dd8cefff2ee1371)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:47.906543 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:47.919833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1439/2911] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:47 2022] PUT /identity/v3/projects/7892b9ca51044121ba73469fe9e03841/users/860c5b2a4e194f23ad3d80916d25734a/roles/e88b00d27c2f432c9dd8cefff2ee1371 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:47.930429 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:47.930965 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:47.931279 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:47.959220 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] MFA Rules not processed for user `860c5b2a4e194f23ad3d80916d25734a`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:47.960433 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:48.028807 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1473/2912] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:48.033291 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.092779 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc202a8-638e-46f1-b5ad-010dc23294ee admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.100324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.101022 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.101336 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.101647 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.102398 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.104372 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.129866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1440/2913] 10.222.0.70 () {60 vars in 1152 bytes} [Mon May 16 17:36:48 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:48.134007 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.145444 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752565f5-e37b-41e9-a25e-b32562c3101d None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.203305 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.203981 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.204260 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.204531 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] PATH_INFO: `/v3/users` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.205227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.207249 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.226514 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1474/2914] 10.222.0.70 () {60 vars in 1143 bytes} [Mon May 16 17:36:48 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 16 17:36:48.230705 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.240684 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b37f7-5313-4da7-a2bf-680715dbba81 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.245226 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.245896 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.246172 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.246442 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.247176 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.249324 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.259371 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1441/2915] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:48.263380 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.273842 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396ab51-b764-40e5-aa4c-921c9828e682 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.278461 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.279338 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.279612 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.279883 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] PATH_INFO: `/v3/projects/8cfee78cdb2a4f9cb2378038cf7b3042/users/0b3a4e2265b8440f968dea62715e1b78/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.294343 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfee78cdb2a4f9cb2378038cf7b3042, user_id=0b3a4e2265b8440f968dea62715e1b78, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.297649 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.309196 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1475/2916] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:48 2022] PUT /identity/v3/projects/8cfee78cdb2a4f9cb2378038cf7b3042/users/0b3a4e2265b8440f968dea62715e1b78/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:48.313141 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.323202 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3216e7-f550-476f-9fdc-5f9b8a8801b3 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.378095 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77762029-add2-422b-a946-f597d833a9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.378686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762029-add2-422b-a946-f597d833a9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.378960 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762029-add2-422b-a946-f597d833a9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.379225 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77762029-add2-422b-a946-f597d833a9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.379937 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77762029-add2-422b-a946-f597d833a9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.381530 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77762029-add2-422b-a946-f597d833a9ce admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.390974 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1442/2917] 10.222.0.70 () {58 vars in 1121 bytes} [Mon May 16 17:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 16 17:36:48.395159 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.406021 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba4fc7-2732-44ba-851d-832b1f115291 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.416004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.416938 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.417218 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.417481 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] PATH_INFO: `/v3/projects/8cfee78cdb2a4f9cb2378038cf7b3042/users/0b3a4e2265b8440f968dea62715e1b78/roles/b991e55ff57e404a92b0f2d7339efc00` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.419571 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfee78cdb2a4f9cb2378038cf7b3042, user_id=0b3a4e2265b8440f968dea62715e1b78, role_id=b991e55ff57e404a92b0f2d7339efc00)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.423066 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.433702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1476/2918] 10.222.0.70 () {60 vars in 1482 bytes} [Mon May 16 17:36:48 2022] PUT /identity/v3/projects/8cfee78cdb2a4f9cb2378038cf7b3042/users/0b3a4e2265b8440f968dea62715e1b78/roles/b991e55ff57e404a92b0f2d7339efc00 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:48.444533 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.444815 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.445088 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.472180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] MFA Rules not processed for user `0b3a4e2265b8440f968dea62715e1b78`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:48.473416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:48.542096 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1443/2919] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:48.554132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:48.555992 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:48.615456 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c2a3f-8817-4cdf-9b17-ff20e57f79cf admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:48.618829 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:48.619517 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:48.619793 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:48.620062 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:48.678166 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:48.679540 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:48.688553 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1477/2920] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 16 17:36:50.175183 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:50.176686 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:50.188982 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8813a0a-6986-48a2-8120-f33c73573f75 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:50.192758 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:50.193409 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:50.193661 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:50.193957 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:50.251602 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:50.253090 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:50.262131 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1444/2921] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:50.766942 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:50.775680 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483ce6-4d12-4bdd-9f85-6634afc2f2b6 service cinder] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:50.779242 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5d1e5-a0ff-496b-b144-b9ec0c58738c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d39e375e994373b5bd403baa053e45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:50.780381 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d1e5-a0ff-496b-b144-b9ec0c58738c service cinder] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:50.780662 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d1e5-a0ff-496b-b144-b9ec0c58738c service cinder] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:50.780935 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d1e5-a0ff-496b-b144-b9ec0c58738c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:50.789926 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5d1e5-a0ff-496b-b144-b9ec0c58738c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:50.791361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5d1e5-a0ff-496b-b144-b9ec0c58738c service cinder] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:50.801311 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1478/2922] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:54.651797 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:54.714837 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864554be-a237-4825-b4bd-fb61887171d4 service cinder] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:54.720122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:54.721000 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:54.721271 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:54.721559 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] PATH_INFO: `/v3/users/6ed13b3c4a274ce6a47bf5237cef753a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:54.722781 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed13b3c4a274ce6a47bf5237cef753a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:54.724716 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:54.772517 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed13b3c4a274ce6a47bf5237cef753a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:54.779147 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed13b3c4a274ce6a47bf5237cef753a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:54.787624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed13b3c4a274ce6a47bf5237cef753a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:54.788438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed13b3c4a274ce6a47bf5237cef753a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:54.800808 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed13b3c4a274ce6a47bf5237cef753a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:54.806929 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1445/2923] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:54 2022] DELETE /identity/v3/users/6ed13b3c4a274ce6a47bf5237cef753a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:54.811640 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] REQUEST_METHOD: `POST` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:54.812106 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:54.812188 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:54.830492 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.auth.core [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] MFA Rules not processed for user `f37f6f0cc485427c90ba2081965287a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79955) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:36:54.831688 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:54.890228 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1479/2924] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:36:54.902003 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:54.903483 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:54.964024 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa321bad-90f8-4504-8089-051f0c75b58d admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:54.968281 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:54.968857 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:54.969130 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:54.969396 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:54.978289 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:54.979654 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:54.989928 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1446/2925] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:36:55.255325 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:55.256990 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:55.270801 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb69f4-784c-4656-9642-a41986608aa9 None None] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:55.275448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:55.276304 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:55.276584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:55.276855 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] PATH_INFO: `/v3/projects/7fb034f11b2940a88c04cdde1bc1e0eb` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:55.278076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb034f11b2940a88c04cdde1bc1e0eb)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:55.280625 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:55.326357 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb034f11b2940a88c04cdde1bc1e0eb', 'request_id': 'req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.333229 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb034f11b2940a88c04cdde1bc1e0eb', 'request_id': 'req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.338748 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb034f11b2940a88c04cdde1bc1e0eb', 'request_id': 'req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.349959 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] The token cache is being invalidate because project 7fb034f11b2940a88c04cdde1bc1e0eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:55.350271 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.350943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.352596 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1480/2926] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:55 2022] DELETE /identity/v3/projects/7fb034f11b2940a88c04cdde1bc1e0eb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:36:55.356795 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:55.366923 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5065e88-74d6-4b50-899e-512fa12f2ef7 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:55.420047 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:55.421416 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:55.421690 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:55.421980 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] PATH_INFO: `/v3/users/860c5b2a4e194f23ad3d80916d25734a` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:55.423146 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860c5b2a4e194f23ad3d80916d25734a)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:55.425056 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:55.470745 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860c5b2a4e194f23ad3d80916d25734a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.477211 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860c5b2a4e194f23ad3d80916d25734a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.484832 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860c5b2a4e194f23ad3d80916d25734a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.485468 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860c5b2a4e194f23ad3d80916d25734a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.497408 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860c5b2a4e194f23ad3d80916d25734a'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.503976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1447/2927] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:55 2022] DELETE /identity/v3/users/860c5b2a4e194f23ad3d80916d25734a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:55.774490 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:55.776004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:55.789661 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56fd42-8301-4d6e-b8f0-c8484aa875b1 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:55.847460 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:55.848316 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:55.848591 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:55.848856 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] PATH_INFO: `/v3/projects/7892b9ca51044121ba73469fe9e03841` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:55.850076 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7892b9ca51044121ba73469fe9e03841)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:55.852011 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:55.897529 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7892b9ca51044121ba73469fe9e03841', 'request_id': 'req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.903921 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7892b9ca51044121ba73469fe9e03841', 'request_id': 'req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.909943 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7892b9ca51044121ba73469fe9e03841', 'request_id': 'req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.925387 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] The token cache is being invalidate because project 7892b9ca51044121ba73469fe9e03841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:55.925697 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.926361 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:55.927898 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1481/2928] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:55 2022] DELETE /identity/v3/projects/7892b9ca51044121ba73469fe9e03841 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:55.932020 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:55.933390 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:55.946106 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6000-31d0-4d71-b5de-f929a5841504 admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:55.999650 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:56.000438 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:56.000711 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:56.000976 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] PATH_INFO: `/v3/users/0b3a4e2265b8440f968dea62715e1b78` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:56.002164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3a4e2265b8440f968dea62715e1b78)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:56.004084 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:56.047741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3a4e2265b8440f968dea62715e1b78'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.054222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3a4e2265b8440f968dea62715e1b78'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.061294 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3a4e2265b8440f968dea62715e1b78'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.061952 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3a4e2265b8440f968dea62715e1b78'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.073419 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-06307360-c21b-4710-bf2c-fba3315f629c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3a4e2265b8440f968dea62715e1b78'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.079735 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1448/2929] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:36:55 2022] DELETE /identity/v3/users/0b3a4e2265b8440f968dea62715e1b78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:36:56.355705 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:36:56.357248 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:36:56.370200 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640b26-bc9d-4dcf-a2ac-398aeb6c7f67 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:36:56.427480 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:36:56.428346 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:36:56.428619 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:36:56.428890 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] PATH_INFO: `/v3/projects/8cfee78cdb2a4f9cb2378038cf7b3042` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:36:56.430077 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfee78cdb2a4f9cb2378038cf7b3042)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:36:56.431996 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:36:56.476541 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfee78cdb2a4f9cb2378038cf7b3042', 'request_id': 'req-1740fdc4-bc83-48fd-be09-0420805ba3d3'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.483995 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfee78cdb2a4f9cb2378038cf7b3042', 'request_id': 'req-1740fdc4-bc83-48fd-be09-0420805ba3d3'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.489611 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfee78cdb2a4f9cb2378038cf7b3042', 'request_id': 'req-1740fdc4-bc83-48fd-be09-0420805ba3d3'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.500917 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] The token cache is being invalidate because project 8cfee78cdb2a4f9cb2378038cf7b3042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:36:56.501225 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.502003 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:36:56.503665 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1482/2930] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:36:56 2022] DELETE /identity/v3/projects/8cfee78cdb2a4f9cb2378038cf7b3042 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:37:39.333801 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] REQUEST_METHOD: `POST` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:39.334315 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:39.334406 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:39.351996 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.auth.core [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] MFA Rules not processed for user `a2a9871c81d649a897166091dd1d4af8`. Rule list: `[]` (Enabled: `True`). {{(pid=79956) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 16 17:37:39.353187 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:39.404215 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1449/2931] 10.222.0.70 () {58 vars in 957 bytes} [Mon May 16 17:37:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 16 17:37:42.619301 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:37:42.624778 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:42.729161 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740fdc4-bc83-48fd-be09-0420805ba3d3 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:37:42.735045 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:37:42.735720 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:37:42.736004 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:37:42.736382 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:37:42.738983 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:37:42.759931 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:37:42.763902 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:37:42.780968 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1483/2932] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:37:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:19.255325 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:19.256860 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:19.310277 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c4fea-de80-4801-9187-5b642dabeec2 None None] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:19.313817 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:19.314456 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:19.315001 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:19.315273 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:19.317521 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:19.327057 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:19.328492 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:19.337041 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1450/2933] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:39:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:24.386952 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:24.388378 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:24.399733 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfe62-c59c-412f-8a42-5e18d66f471a service nova] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:24.403268 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:24.403903 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:24.404177 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:24.404448 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:24.406240 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:24.422757 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:24.424214 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:24.434093 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1484/2934] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:39:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:25.271148 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:25.287080 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad482bf-93bd-44f8-977f-f0e902ffad11 service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:25.293852 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0134f8e7c1401eb79c443f67174a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:25.294541 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:25.294819 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:25.295089 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:25.297005 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:25.310268 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:25.311873 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:25.323941 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1451/2935] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:25.462395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:25.474323 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cecd3-a645-472f-bdf7-b1657f4c9eb6 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:25.477964 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:25.478702 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:25.478982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:25.479246 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:25.481035 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:25.495718 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:25.497164 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:25.508498 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1485/2936] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:26.693595 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:26.703180 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4f11-9755-4356-8b54-253e7de0c2ec service nova] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:26.706919 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:26.707574 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:26.707850 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:26.708122 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:26.709964 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:26.724741 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:26.726240 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:26.738561 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1452/2937] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:39:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:37.897155 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:37.905979 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efa25d-3c52-4eb1-b978-b5370fac962b service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:37.910087 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4920e5f3dcdc4b068f4a0b3a1f9bc03a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:37.910726 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] REQUEST_METHOD: `GET` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:37.910998 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:37.911265 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:37.913227 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:37.974908 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:37.976285 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:37.985813 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1486/2938] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 16 17:39:43.951864 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:43.954046 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:43.974699 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4411-86f5-4e28-831f-667ceb67115c service neutron] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:43.979624 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:43.980683 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:43.981621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:43.981621 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] PATH_INFO: `/v3/users/a2a9871c81d649a897166091dd1d4af8` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:43.983812 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a9871c81d649a897166091dd1d4af8)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:43.985833 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:44.037866 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a9871c81d649a897166091dd1d4af8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.044962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a9871c81d649a897166091dd1d4af8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.053793 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a9871c81d649a897166091dd1d4af8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.054440 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a9871c81d649a897166091dd1d4af8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.068196 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a9871c81d649a897166091dd1d4af8'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.075164 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1453/2939] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:39:43 2022] DELETE /identity/v3/users/a2a9871c81d649a897166091dd1d4af8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 16 17:39:44.252584 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:44.263424 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5a2e9-3e1e-4ffb-a3d5-834f9828d409 service neutron] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:44.323754 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:44.324617 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:44.324896 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:44.325172 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] PATH_INFO: `/v3/projects/56b80ff77ba34997843a869bd2707989` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:44.326395 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b80ff77ba34997843a869bd2707989)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:44.328354 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:44.373039 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b80ff77ba34997843a869bd2707989', 'request_id': 'req-98ed21c4-0885-40f8-8c80-ab90a1c36225'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.380628 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b80ff77ba34997843a869bd2707989', 'request_id': 'req-98ed21c4-0885-40f8-8c80-ab90a1c36225'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.385982 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b80ff77ba34997843a869bd2707989', 'request_id': 'req-98ed21c4-0885-40f8-8c80-ab90a1c36225'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.396820 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] The token cache is being invalidate because project 56b80ff77ba34997843a869bd2707989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:39:44.397132 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.397800 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.399366 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1487/2940] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:39:44 2022] DELETE /identity/v3/projects/56b80ff77ba34997843a869bd2707989 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:44.403354 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:44.404788 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:44.418097 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f671b-d4b3-4fab-bee5-e853beedd02e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:44.472335 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:44.473222 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:44.473497 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:44.473800 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] PATH_INFO: `/v3/users/fb76ddd4d50d4309ab4d3ef8442d46b1` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:44.474997 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb76ddd4d50d4309ab4d3ef8442d46b1)` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:44.476958 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:44.524645 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb76ddd4d50d4309ab4d3ef8442d46b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.531265 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb76ddd4d50d4309ab4d3ef8442d46b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.540165 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb76ddd4d50d4309ab4d3ef8442d46b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.540777 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb76ddd4d50d4309ab4d3ef8442d46b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.553033 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.notifications [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb76ddd4d50d4309ab4d3ef8442d46b1'} {{(pid=79956) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.558932 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1454/2941] 10.222.0.70 () {58 vars in 1223 bytes} [Mon May 16 17:39:44 2022] DELETE /identity/v3/users/fb76ddd4d50d4309ab4d3ef8442d46b1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:39:44.730545 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Authenticating user token {{(pid=79955) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:39:44.732108 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.fernet_utils [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79955) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:39:44.745579 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed21c4-0885-40f8-8c80-ab90a1c36225 admin admin] Validating token access rules against request {{(pid=79955) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:39:44.802746 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f37f6f0cc485427c90ba2081965287a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca989f1268f4da189675a074fd55f83', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79955) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:39:44.803502 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:39:44.803780 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] SCRIPT_NAME: `/identity` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:39:44.804051 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] PATH_INFO: `/v3/projects/e9f3a23fcb6e40c7a86962473a518ae3` {{(pid=79955) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:39:44.805223 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f3a23fcb6e40c7a86962473a518ae3)` {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:39:44.807190 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] RBAC: Authorization granted {{(pid=79955) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:39:44.853009 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f3a23fcb6e40c7a86962473a518ae3', 'request_id': 'req-06a1548e-3979-438d-bb00-a87e196276af'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.860363 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f3a23fcb6e40c7a86962473a518ae3', 'request_id': 'req-06a1548e-3979-438d-bb00-a87e196276af'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.865920 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f3a23fcb6e40c7a86962473a518ae3', 'request_id': 'req-06a1548e-3979-438d-bb00-a87e196276af'} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.876833 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] The token cache is being invalidate because project e9f3a23fcb6e40c7a86962473a518ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79955) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 16 17:39:44.877114 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.878336 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: DEBUG keystone.notifications [None req-06a1548e-3979-438d-bb00-a87e196276af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79955) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 16 17:39:44.879922 dv-cinder-839987-4-iscsi devstack@keystone.service[79955]: [pid: 79955|app: 0|req: 1488/2942] 10.222.0.70 () {58 vars in 1232 bytes} [Mon May 16 17:39:44 2022] DELETE /identity/v3/projects/e9f3a23fcb6e40c7a86962473a518ae3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 16 17:41:20.907962 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Authenticating user token {{(pid=79956) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 16 17:41:20.909478 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.034695 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112e06-1540-4354-8e59-51068a07c88e admin admin] Validating token access rules against request {{(pid=79956) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 16 17:41:21.092332 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4147f3dfb94f49a0b6e08d16323d51a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c591b8c8d8644c4be2153a81bd6b4a1', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79956) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 16 17:41:21.092983 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] REQUEST_METHOD: `GET` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 16 17:41:21.093259 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] SCRIPT_NAME: `/identity` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 16 17:41:21.093531 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79956) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 16 17:41:21.095337 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.fernet_utils [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79956) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 16 17:41:21.106938 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 16 17:41:21.108523 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818a094-b11b-4ef8-b5b9-8d3d0c9fd542 service placement] RBAC: Authorization granted {{(pid=79956) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 16 17:41:21.118192 dv-cinder-839987-4-iscsi devstack@keystone.service[79956]: [pid: 79956|app: 0|req: 1455/2943] 10.222.0.70 () {60 vars in 1365 bytes} [Mon May 16 17:41:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)